Runtime Server - Error in BeginRequest

Oct 8, 2008 at 1:39 PM
I'm encountering errors from the Runtime Server that I can't track down and I'm hoping someone can point me in the right direction.

We have external clients calling into an MSE endpoint and recently some have been receiving an exception back stating "The system cannot find the file specified".  I found the following in the MSE Runtime text log:

mseTraceSrc Error: 0 : Error in BeginRequest: The system cannot find the file specifiedstack trace:    at MS.Win32.UnsafeNativeMethods.RegisterClassEx(WNDCLASSEX_D wc_d)
   at MS.Win32.HwndWrapper..ctor(Int32 classStyle, Int32 style, Int32 exStyle, Int32 x, Int32 y, Int32 width, Int32 height, String name, IntPtr parent, HwndWrapperHook[] hooks)
   at System.Windows.Threading.Dispatcher..ctor()
   at System.Windows.Threading.Dispatcher.get_CurrentDispatcher()
   at System.Windows.Markup.XamlTreeBuilder.ParseFragment()
   at System.Windows.Markup.TreeBuilder.Parse()
   at System.Windows.Markup.XamlReader.XmlTreeBuildDefault(ParserContext pc, XmlReader reader, Boolean wrapWithMarkupCompatReader, XamlParseMode parseMode, Boolean etwTracingEnabled)
   at System.Windows.Markup.XamlReader.Load(XmlReader reader)
   at Microsoft.MSE.Runtime.Module.Channel.ChannelLoader.GetChannelBindingFromMarkup(XmlElement channelMetadata)
   at Microsoft.MSE.Runtime.Services.Broker.BrokerServiceInstance.GetBindingFromChannelModel(OperationVersion operationVersion)
   at Microsoft.MSE.Runtime.Services.Broker.BrokerServiceInstance.BeginRequest(Message message, AsyncCallback cb, Object state)

Below is an excerpt from the runtime svclog and you can see the "Error in BeginRequest" action on the "The security protocol secured the outgoing message" event.  MSE is exposing a WCF windows service and there is nothing in the trace log for that service when this error occurs.  Also, you can see from the trace below that about 15 minutes after the "Error in BeginRequest" message occurs, exceptions show up about the channel being aborted.  Any thoughts?


<E2ETraceEvent xmlns="http://schemas.microsoft.com/2004/06/E2ETraceEvent">
<System xmlns="http://schemas.microsoft.com/2004/06/windows/eventlog/system">
<EventID>0</EventID>
<Type>3</Type>
<SubType Name="Transfer">0</SubType>
<Level>255</Level>
<TimeCreated SystemTime="2008-10-06T18:34:18.8216550Z" />
<Source Name="System.ServiceModel" />
<Correlation ActivityID="{ed123d74-409a-4a12-8ca5-58cc06261d53}" RelatedActivityID="{dd9e1ee4-57a7-40b4-ac9f-a6cab6cf957e}" />
<Execution ProcessName="Microsoft.MSE.Runtime.ServiceHost" ProcessID="3952" ThreadID="12" />
<Channel />
<Computer>111915-WEB1</Computer>
</System>
<ApplicationData></ApplicationData>
</E2ETraceEvent>

<E2ETraceEvent xmlns="http://schemas.microsoft.com/2004/06/E2ETraceEvent">
<System xmlns="http://schemas.microsoft.com/2004/06/windows/eventlog/system">
<EventID>131085</EventID>
<Type>3</Type>
<SubType Name="Start">0</SubType>
<Level>255</Level>
<TimeCreated SystemTime="2008-10-06T18:34:18.8216550Z" />
<Source Name="System.ServiceModel" />
<Correlation ActivityID="{dd9e1ee4-57a7-40b4-ac9f-a6cab6cf957e}" />
<Execution ProcessName="Microsoft.MSE.Runtime.ServiceHost" ProcessID="3952" ThreadID="12" />
<Channel />
<Computer>111915-WEB1</Computer>
</System>
<ApplicationData>
<TraceData>
<DataItem>
<TraceRecord xmlns="http://schemas.microsoft.com/2004/10/E2ETraceEvent/TraceRecord" Severity="Start">
<TraceIdentifier>http://msdn.microsoft.com/en-US/library/System.ServiceModel.Diagnostics.ActivityBoundary.aspx</TraceIdentifier>
<Description>Activity boundary.</Description>
<AppDomain>Microsoft.MSE.Runtime.ServiceHost.exe</AppDomain>
<ExtendedData xmlns="http://schemas.microsoft.com/2006/08/ServiceModel/DictionaryTraceRecord">
<ActivityName>Process action 'GetTitleProductRequests'.</ActivityName>
<ActivityType>ProcessAction</ActivityType>
</ExtendedData>
</TraceRecord>
</DataItem>
</TraceData>
</ApplicationData>
</E2ETraceEvent>

<E2ETraceEvent xmlns="http://schemas.microsoft.com/2004/06/E2ETraceEvent">
<System xmlns="http://schemas.microsoft.com/2004/06/windows/eventlog/system">
<EventID>262162</EventID>
<Type>3</Type>
<SubType Name="Information">0</SubType>
<Level>8</Level>
<TimeCreated SystemTime="2008-10-06T18:34:18.8216550Z" />
<Source Name="System.ServiceModel" />
<Correlation ActivityID="{dd9e1ee4-57a7-40b4-ac9f-a6cab6cf957e}" />
<Execution ProcessName="Microsoft.MSE.Runtime.ServiceHost" ProcessID="3952" ThreadID="12" />
<Channel />
<Computer>111915-WEB1</Computer>
</System>
<ApplicationData>
<TraceData>
<DataItem>
<TraceRecord xmlns="http://schemas.microsoft.com/2004/10/E2ETraceEvent/TraceRecord" Severity="Information">
<TraceIdentifier>http://msdn.microsoft.com/en-US/library/System.ServiceModel.Channels.MessageReceived.aspx</TraceIdentifier>
<Description>Received a message over a channel.</Description>
<AppDomain>Microsoft.MSE.Runtime.ServiceHost.exe</AppDomain>
<Source>System.ServiceModel.Channels.HttpRequestContext+ListenerHttpContext+ListenerContextHttpInput/62445567</Source>
<ExtendedData xmlns="http://schemas.microsoft.com/2006/08/ServiceModel/MessageTransmitTraceRecord">
<MessageProperties>
<Encoder>application/soap+xml; charset=utf-8</Encoder>
<AllowOutputBatching>False</AllowOutputBatching>
<Via>http://services.default-net.com/TitleProductService</Via>
</MessageProperties>
<MessageHeaders>
<a:Action s:mustUnderstand="1" u:Id="_2" xmlns:u="http://docs.oasis-open.org/wss/2004/01/oasis-200401-wss-wssecurity-utility-1.0.xsd" xmlns:s="http://www.w3.org/2003/05/soap-envelope" xmlns:a="GetTitleProductRequestshttp://www.w3.org/2005/08/addressing">GetTitleProductRequests</a:Action>
<a:MessageID u:Id="_3" xmlns:u="http://docs.oasis-open.org/wss/2004/01/oasis-200401-wss-wssecurity-utility-1.0.xsd" xmlns:a="urn:uuid:c5f654d4-3d61-43a2-970d-e09bc84b2f1dhttp://www.w3.org/2005/08/addressing">urn:uuid:c5f654d4-3d61-43a2-970d-e09bc84b2f1d</a:MessageID>
<a:ReplyTo u:Id="_4" xmlns:u="http://docs.oasis-open.org/wss/2004/01/oasis-200401-wss-wssecurity-utility-1.0.xsd" xmlns:a="http://www.w3.org/2005/08/addressing">
<a:Address>http://www.w3.org/2005/08/addressing/anonymous</a:Address>
</a:ReplyTo>
<a:To s:mustUnderstand="1" u:Id="_5" xmlns:u="http://docs.oasis-open.org/wss/2004/01/oasis-200401-wss-wssecurity-utility-1.0.xsd" xmlns:s="http://www.w3.org/2003/05/soap-envelope" xmlns:a="http://www.w3.org/2005/08/addressing>
<o:Security s:mustUnderstand="1" xmlns:o="http://docs.oasis-open.org/wss/2004/01/oasis-200401-wss-wssecurity-secext-1.0.xsd" xmlns:s="http://www.w3.org/2003/05/soap-envelope">
<u:Timestamp u:Id="uuid-e55dbc1d-4cfd-441f-bfee-720565a2b6f0-219" xmlns:u="http://docs.oasis-open.org/wss/2004/01/oasis-200401-wss-wssecurity-utility-1.0.xsd">
<u:Created>2008-10-06T18:34:19.081Z</u:Created>
<u:Expires>2008-10-06T18:39:19.081Z</u:Expires>
</u:Timestamp>
<c:SecurityContextToken u:Id="uuid-4d6bd3ed-fd63-47b0-bd45-39d15af5e3f7-63316" xmlns:c="http://schemas.xmlsoap.org/ws/2005/02/sc" xmlns:u="http://docs.oasis-open.org/wss/2004/01/oasis-200401-wss-wssecurity-utility-1.0.xsd">
<c:Identifier>urn:uuid:63778dbd-9070-4ba8-b2e7-f441d496c741</c:Identifier>
</c:SecurityContextToken>
<c:DerivedKeyToken u:Id="uuid-e55dbc1d-4cfd-441f-bfee-720565a2b6f0-217" xmlns:c="http://schemas.xmlsoap.org/ws/2005/02/sc" xmlns:u="http://docs.oasis-open.org/wss/2004/01/oasis-200401-wss-wssecurity-utility-1.0.xsd">
<o:SecurityTokenReference>
<o:Reference ValueType="http://schemas.xmlsoap.org/ws/2005/02/sc/sct" URI="#uuid-4d6bd3ed-fd63-47b0-bd45-39d15af5e3f7-63316"></o:Reference>
</o:SecurityTokenReference>
<c:Offset>0</c:Offset>
<c:Length>24</c:Length>
<c:Nonce>
<!-- Removed -->
</c:Nonce>
</c:DerivedKeyToken>
<c:DerivedKeyToken u:Id="uuid-e55dbc1d-4cfd-441f-bfee-720565a2b6f0-218" xmlns:c="http://schemas.xmlsoap.org/ws/2005/02/sc" xmlns:u="http://docs.oasis-open.org/wss/2004/01/oasis-200401-wss-wssecurity-utility-1.0.xsd">
<o:SecurityTokenReference>
<o:Reference ValueType="http://schemas.xmlsoap.org/ws/2005/02/sc/sct" URI="#uuid-4d6bd3ed-fd63-47b0-bd45-39d15af5e3f7-63316"></o:Reference>
</o:SecurityTokenReference>
<c:Nonce>
<!-- Removed -->
</c:Nonce>
</c:DerivedKeyToken>
<e:ReferenceList xmlns:e="http://www.w3.org/2001/04/xmlenc#">
<e:DataReference URI="#_1"></e:DataReference>
<e:DataReference URI="#_6"></e:DataReference>
</e:ReferenceList>
<e:EncryptedData Id="_6" Type="http://www.w3.org/2001/04/xmlenc#Element" xmlns:e="http://www.w3.org/2001/04/xmlenc#">
<e:EncryptionMethod Algorithm="http://www.w3.org/2001/04/xmlenc#aes256-cbc>
<KeyInfo xmlns="http://www.w3.org/2000/09/xmldsig#">
<o:SecurityTokenReference>
<o:Reference ValueType="http://schemas.xmlsoap.org/ws/2005/02/sc/dk" URI="#uuid-e55dbc1d-4cfd-441f-bfee-720565a2b6f0-218"></o:Reference>
</o:SecurityTokenReference>
</KeyInfo>
<e:CipherData>
<e:CipherValue>7sbbKriqKyfysjz/gogiB9fxWmYfE1g5ifKeOMk69ksZMT8dN5xezSbpcgTTa3gNvpcqEVYi67Y46hoNsZ9XIL5fN62kCrrLbtgyF9UaQmkDlvAw+aWoyoE/etbNDBw0iGqgFU5Wai0wE8sMmwY7sC8XyCVS0IdtDesvYUq5VjBTCP63LEdEVgbNQnscFGRj8F5/C4pcxj3Z/Rti+k2Q0lujclTgkmYi+9PA46KOfuQvCTn1v8TWzQ+zg60i4k1FnQtfW0HLfzvJ6O/K7CZAdbh8sn0uwRvY9eNKy8ydyvkEmmvbVF8yjeMHEOPWmhdiwiaYiNdM7WmSioVIeOiLmgVakPN6MyZWFlhQBbOaXWtafKDORK9DBv+ptbgamtyStkvBApF0b9EGQSfKtLm9eoOy0TIySxIhxgj6EIEZMFjQFxP1YdnnX8eqbKzD10+LcooOPuK3WnAkb8n4YiDDj8QnRrmfU1bUoUADCet2mKSt/zymrtXERII0ci/Jmn7hxpWmmnjoHZp8kW3ZpHI7DclVKq13pGzV3/t804Mwy1X334nxA/dJkDcrntk35K3k9tFip7KwJwknp4ya0Tfp4Jp9chVYpZaV+jCqIv76p7Ur/Hnxdif2X9+9toiEfPHujqFZRIiQPcmv3exXK+kU+1NMolv8Q/Kr8LRi2pG/IS3euk/cjBSlbh7zWWwwUFPDtyCsMsKMjeJiIeM87JlcFQedo4c1hn6cgtsXAsVPMeAdme82Mo1T8Tk67SEpkkUTURJJbtQU9CjeNzDP+YHy5IonbPiK4UYWBetasMDkHtTnJBnkyo4RPD7hf/lBZ+zNNsuyyToS6oUZkZ+36ntCwWu+f4BYRETuIKUtTVXA/pboy/D96CSJg6I2DwcrL1imtGPZSR0koXbBwISSLzd7nKojo6wh0p4bsd87TmMOZYRmv5GiFCQ2rraJjvSdXzpeGH2FDBMD3ICK+ITQHKn15SBq3N6kephaF3jAWbPzYYLWyfkrIxGF1cqdoRVSNSjKWLd3WDOrM8jw/aw6Dp1pcSExCsmhgdHiF47n772luPeXHxcP4mp9HF+L9xeSjupb1H67ZozxkXDN6UiuAOlQXPHwNT/anjIjhZq+52OAtoibz8p3oKN1Q2uWmRRMy5cR4iewOwe+RupATPQTz0+kWk2hJu45VGB8R+xT3JE7ddHFO5vZGqMTLN/rwN+bbhqgmhrCoVpiNW6Ctpno98SjxvUiY6pJQFNVT7cwMVpcVNDz5tWrbU70nac+uMMIIbZ27w2xh8gw8cVzEUgniB827pDvKaWzbqZPdCcYsrprLpSSThrGVnaxqX/3y+Qlfk8OlzRx+896echg82h5MYXF0oZTdkofYvplSu274Ly1gOsLBbhhdbA3e9ASVP2/2fy+JmKhmkN7tECEbVdHJ1uWhXNakOchxz66MdZfdMVzPJ+kMbdPC2TiH7sbz3Fwr6rDGOUf7sQEtXY7Jeh7yorVnNNPLE6gfhppb9/ogWLkmghJVw8/11uK3680Cb0XslFvmMMqnMFQaQb5Z6vf30MiGWDY4X9T6rWrio6a3tIMaW9eVh6BcdRxbNQ9nP+9eXExqfs7CiAbCvIhXga6zz5VOSJgNaCAEu7b/66Vak78D4dcLTrrun8sx5cjUzsNJrkYzsz40uqewICGTERJqQKGiO6i76FnuazRjCWEC/zZuFET5MpXJh+rTPMEkBPBw/l68DJHnhR8RtOQgz1nPwv7kFpjWPhBraqmcF+C1jP69t7j+gClm69x8i0gnR4DHc8tcsGaqVQ9apr5hw+NnHHTwP8VmFD2sZKyJPtxywd67ceH6Tn3nXzK9VyVTdnHF7PBlHWqtQbMm/eMsS2XuPAfvj+QPptKC35HPotX7JsitTBmTeTuv1WHhZJP5JjOZr3vd7RkHN2zpXUrBCRpIoOyZYPrcnTgtu1oDQsRVz0U6FgCKWrZE+vMxwGxM+kl9XPEJbg7Zmb0Wt/A87qu67Gqr8vMlLZimgfa5REcQqojv7veuncSHKDJQyRpD0XxvYdZ23lr6dxprhnuIw7JoWFRxw8E65YuCJ4+XduRB7JVJ172ccdhBYOG8vxArAcTybgs1BeZsV1rDBihSYC8Lku2a8rqvQAoUI47RwLMSUPKcEVDQK+NqfXn55VQUU/c0TaS2BRbyarmI4cK9n3M3hEk9aTndhEJzN2g3G9zPLo24hFFiimvd0GATaiATLp0o5VXpf2XZf9T/YZ/TUiYZxYGV4n1peTu098vJtkIKsKYWcp0UciKYEtWgZaBn4VNOx0NYAZBzs+bgogDYT4Amc/82Qu9mbS1+G0jVRAefHvQcwWD+FvJxULVUp4Vrk9sHA5Jd9dQEhwLforPa5AueVhT7Eaopx1l2fNX09TyX+0aL+03kFZy/in0dLTFAjimsDpKmUCB2q2f+OeOPLx6MXToxs8jjll5gTVQifDiLbMfAoFZi1i6A8bKH7WExQBL7FM0Xcmxe8qbq0uY4xi5qt2ckJRee5H1KfZJ3SulB3zFSrj2H39mwFczFdgWQWfq97ORdKEG/2cQ5p85jHvU76kO7f38aus7bR4HGuBNm3umb66EHpybYa3OK4ou1z/NoxXU7LDCP12SN5OIhTrZ1QIB8eHdlfOU8hXjn3PzeUzaA3vhZeP9ouZLr0L8SRqefxJYVAcKrwiPXWr0IV6EFFAGh0WHMKeMw9ARRki4l21R/wlE0JqjY7OTzACJ0XTbc/ObWmmlY9Rkf1dwUf95RZEGKtob1W8JCh57f3TI4SD0+/TNGZ4eMU6Q92eryBKEP614</e:CipherValue>
</e:CipherData>
</e:EncryptedData>
</o:Security>
</MessageHeaders>
</ExtendedData>
</TraceRecord>
</DataItem>
</TraceData>
</ApplicationData>
</E2ETraceEvent>

<E2ETraceEvent xmlns="http://schemas.microsoft.com/2004/06/E2ETraceEvent">
<System xmlns="http://schemas.microsoft.com/2004/06/windows/eventlog/system">
<EventID>458782</EventID>
<Type>3</Type>
<SubType Name="Information">0</SubType>
<Level>8</Level>
<TimeCreated SystemTime="2008-10-06T18:34:18.8216550Z" />
<Source Name="System.ServiceModel" />
<Correlation ActivityID="{dd9e1ee4-57a7-40b4-ac9f-a6cab6cf957e}" />
<Execution ProcessName="Microsoft.MSE.Runtime.ServiceHost" ProcessID="3952" ThreadID="6" />
<Channel />
<Computer>111915-WEB1</Computer>
</System>
<ApplicationData>
<TraceData>
<DataItem>
<TraceRecord xmlns="http://schemas.microsoft.com/2004/10/E2ETraceEvent/TraceRecord" Severity="Information">
<TraceIdentifier>http://msdn.microsoft.com/en-US/library/System.ServiceModel.Security.SecurityBindingIncomingMessageVerified.aspx</TraceIdentifier>
<Description>The security protocol verified the incoming message.</Description>
<AppDomain>Microsoft.MSE.Runtime.ServiceHost.exe</AppDomain>
<ExtendedData xmlns="http://schemas.microsoft.com/2006/08/ServiceModel/SecurityProtocolTraceRecord">
<SecurityProtocol>System.ServiceModel.Security.AcceptorSessionSymmetricMessageSecurityProtocol</SecurityProtocol>
<Action>GetTitleProductRequests</Action>
<To>http://services.default-net.com/TitleProductService</To>
<EndpointReference xmlns="http://www.w3.org/2005/08/addressing">
<Address>http://www.w3.org/2005/08/addressing/anonymous</Address>
</EndpointReference>
<MessageId>urn:uuid:c5f654d4-3d61-43a2-970d-e09bc84b2f1d</MessageId>
</ExtendedData>
</TraceRecord>
</DataItem>
</TraceData>
</ApplicationData>
</E2ETraceEvent>

<E2ETraceEvent xmlns="http://schemas.microsoft.com/2004/06/E2ETraceEvent">
<System xmlns="http://schemas.microsoft.com/2004/06/windows/eventlog/system">
<EventID>524331</EventID>
<Type>3</Type>
<SubType Name="Information">0</SubType>
<Level>8</Level>
<TimeCreated SystemTime="2008-10-06T18:34:18.8216550Z" />
<Source Name="System.ServiceModel" />
<Correlation ActivityID="{dd9e1ee4-57a7-40b4-ac9f-a6cab6cf957e}" />
<Execution ProcessName="Microsoft.MSE.Runtime.ServiceHost" ProcessID="3952" ThreadID="6" />
<Channel />
<Computer>111915-WEB1</Computer>
</System>
<ApplicationData>
<TraceData>
<DataItem>
<TraceRecord xmlns="http://schemas.microsoft.com/2004/10/E2ETraceEvent/TraceRecord" Severity="Information">
<TraceIdentifier>http://msdn.microsoft.com/en-US/library/System.ServiceModel.ServiceChannelLifetime.aspx</TraceIdentifier>
<Description>ServiceChannel information.</Description>
<AppDomain>Microsoft.MSE.Runtime.ServiceHost.exe</AppDomain>
<Source>System.ServiceModel.Channels.ServiceChannel/56639598</Source>
<ExtendedData xmlns="http://schemas.microsoft.com/2006/08/ServiceModel/DictionaryTraceRecord">
<ServiceType>Microsoft.MSE.Runtime.Services.Broker.BrokerServiceInstance, Microsoft.MSE.Runtime.Services, Version=1.0.0.0, Culture=neutral, PublicKeyToken=31bf3856ad364e35</ServiceType>
<ContractNamespace>http://services.microsoft.com/MSE/Ndex_WsHttpBinding/svc_TitleProductService</ContractNamespace>
<ContractName>svc_TitleProductServiceSoap</ContractName>
<Uri>http://services.default-net.com/TitleProductService</Uri>
</ExtendedData>
</TraceRecord>
</DataItem>
</TraceData>
</ApplicationData>
</E2ETraceEvent>

<E2ETraceEvent xmlns="http://schemas.microsoft.com/2004/06/E2ETraceEvent">
<System xmlns="http://schemas.microsoft.com/2004/06/windows/eventlog/system">
<EventID>458781</EventID>
<Type>3</Type>
<SubType Name="Information">0</SubType>
<Level>8</Level>
<TimeCreated SystemTime="2008-10-06T18:34:19.1029014Z" />
<Source Name="System.ServiceModel" />
<Correlation ActivityID="{dd9e1ee4-57a7-40b4-ac9f-a6cab6cf957e}" />
<Execution ProcessName="Microsoft.MSE.Runtime.ServiceHost" ProcessID="3952" ThreadID="6" />
<Channel />
<Computer>111915-WEB1</Computer>
</System>
<ApplicationData>
<TraceData>
<DataItem>
<TraceRecord xmlns="http://schemas.microsoft.com/2004/10/E2ETraceEvent/TraceRecord" Severity="Information">
<TraceIdentifier>http://msdn.microsoft.com/en-US/library/System.ServiceModel.Security.SecurityBindingOutgoingMessageSecured.aspx</TraceIdentifier>
<Description>The security protocol secured the outgoing message.</Description>
<AppDomain>Microsoft.MSE.Runtime.ServiceHost.exe</AppDomain>
<ExtendedData xmlns="http://schemas.microsoft.com/2006/08/ServiceModel/SecurityProtocolTraceRecord">
<SecurityProtocol>System.ServiceModel.Security.AcceptorSessionSymmetricMessageSecurityProtocol</SecurityProtocol>
<Action>Error in BeginRequest</Action>
<To>http://schemas.microsoft.com/2005/12/ServiceModel/Addressing/Anonymous</To>
</ExtendedData>
</TraceRecord>
</DataItem>
</TraceData>
</ApplicationData>
</E2ETraceEvent>

<E2ETraceEvent xmlns="http://schemas.microsoft.com/2004/06/E2ETraceEvent">
<System xmlns="http://schemas.microsoft.com/2004/06/windows/eventlog/system">
<EventID>262163</EventID>
<Type>3</Type>
<SubType Name="Information">0</SubType>
<Level>8</Level>
<TimeCreated SystemTime="2008-10-06T18:34:19.3060238Z" />
<Source Name="System.ServiceModel" />
<Correlation ActivityID="{dd9e1ee4-57a7-40b4-ac9f-a6cab6cf957e}" />
<Execution ProcessName="Microsoft.MSE.Runtime.ServiceHost" ProcessID="3952" ThreadID="6" />
<Channel />
<Computer>111915-WEB1</Computer>
</System>
<ApplicationData>
<TraceData>
<DataItem>
<TraceRecord xmlns="http://schemas.microsoft.com/2004/10/E2ETraceEvent/TraceRecord" Severity="Information">
<TraceIdentifier>http://msdn.microsoft.com/en-US/library/System.ServiceModel.Channels.MessageSent.aspx</TraceIdentifier>
<Description>Sent a message over a channel.</Description>
<AppDomain>Microsoft.MSE.Runtime.ServiceHost.exe</AppDomain>
<Source>System.ServiceModel.Channels.HttpOutput+ListenerResponseHttpOutput/31935620</Source>
<ExtendedData xmlns="http://schemas.microsoft.com/2006/08/ServiceModel/MessageTraceRecord">
<MessageProperties>
<Encoder>application/soap+xml; charset=utf-8</Encoder>
<AllowOutputBatching>False</AllowOutputBatching>
</MessageProperties>
<MessageHeaders>
<Action d4p1:mustUnderstand="1" xmlns:d4p1="http://www.w3.org/2003/05/soap-envelope" xmlns="Error">http://www.w3.org/2005/08/addressing">Error in BeginRequest</Action>
<RelatesTo xmlns="urn:uuid:c5f654d4-3d61-43a2-970d-e09bc84b2f1d</RELATESTO">http://www.w3.org/2005/08/addressing">urn:uuid:c5f654d4-3d61-43a2-970d-e09bc84b2f1d</RelatesTo>
</MessageHeaders>
</ExtendedData>
</TraceRecord>
</DataItem>
</TraceData>
</ApplicationData>
</E2ETraceEvent>

<E2ETraceEvent xmlns="http://schemas.microsoft.com/2004/06/E2ETraceEvent">
<System xmlns="http://schemas.microsoft.com/2004/06/windows/eventlog/system">
<EventID>131085</EventID>
<Type>3</Type>
<SubType Name="Stop">0</SubType>
<Level>255</Level>
<TimeCreated SystemTime="2008-10-06T18:34:19.3060238Z" />
<Source Name="System.ServiceModel" />
<Correlation ActivityID="{dd9e1ee4-57a7-40b4-ac9f-a6cab6cf957e}" />
<Execution ProcessName="Microsoft.MSE.Runtime.ServiceHost" ProcessID="3952" ThreadID="6" />
<Channel />
<Computer>111915-WEB1</Computer>
</System>
<ApplicationData>
<TraceData>
<DataItem>
<TraceRecord xmlns="http://schemas.microsoft.com/2004/10/E2ETraceEvent/TraceRecord" Severity="Stop">
<TraceIdentifier>http://msdn.microsoft.com/en-US/library/System.ServiceModel.Diagnostics.ActivityBoundary.aspx</TraceIdentifier>
<Description>Activity boundary.</Description>
<AppDomain>Microsoft.MSE.Runtime.ServiceHost.exe</AppDomain>
<ExtendedData xmlns="http://schemas.microsoft.com/2006/08/ServiceModel/DictionaryTraceRecord">
<ActivityName>Process action 'GetTitleProductRequests'.</ActivityName>
<ActivityType>ProcessAction</ActivityType>
</ExtendedData>
</TraceRecord>
</DataItem>
</TraceData>
</ApplicationData>
</E2ETraceEvent>

<E2ETraceEvent xmlns="http://schemas.microsoft.com/2004/06/E2ETraceEvent">
<System xmlns="http://schemas.microsoft.com/2004/06/windows/eventlog/system">
<EventID>131075</EventID>
<Type>3</Type>
<SubType Name="Error">0</SubType>
<Level>2</Level>
<TimeCreated SystemTime="2008-10-06T18:49:18.8257598Z" />
<Source Name="System.ServiceModel" />
<Correlation ActivityID="{dd9e1ee4-57a7-40b4-ac9f-a6cab6cf957e}" />
<Execution ProcessName="Microsoft.MSE.Runtime.ServiceHost" ProcessID="3952" ThreadID="18" />
<Channel />
<Computer>111915-WEB1</Computer>
</System>
<ApplicationData>
<TraceData>
<DataItem>
<TraceRecord xmlns="http://schemas.microsoft.com/2004/10/E2ETraceEvent/TraceRecord" Severity="Error">
<TraceIdentifier>http://msdn.microsoft.com/en-US/library/System.ServiceModel.Diagnostics.ThrowingException.aspx</TraceIdentifier>
<Description>Throwing an exception.</Description>
<AppDomain>Microsoft.MSE.Runtime.ServiceHost.exe</AppDomain>
<Source>System.ServiceModel.Channels.ReplyChannel/42529704</Source>
<Exception>
<ExceptionType>System.ServiceModel.CommunicationObjectAbortedException, System.ServiceModel, Version=3.0.0.0, Culture=neutral, PublicKeyToken=b77a5c561934e089</ExceptionType>
<Message>The communication object, System.ServiceModel.Channels.ReplyChannel, cannot be used for communication because it has been Aborted.</Message>
<StackTrace>
at System.ServiceModel.Channels.CommunicationObject.ThrowIfAborted()
at System.ServiceModel.Channels.ReplyChannel.EndTryReceiveRequest(IAsyncResult result, RequestContext&amp; context)
at System.ServiceModel.Channels.ServerReliableChannelBinder`1.ReplyServerReliableChannelBinder`1.OnEndTryReceive(TReplyChannel channel, IAsyncResult result, RequestContext&amp; requestContext)
at System.ServiceModel.Channels.ReliableChannelBinder`1.TryReceiveAsyncResult.EndInput(ReliableChannelBinder`1 binder, TChannel channel, IAsyncResult result, Boolean&amp; complete)
at System.ServiceModel.Channels.ReliableChannelBinder`1.InputAsyncResult`1.CompleteInput(IAsyncResult result)
at System.ServiceModel.Channels.ReliableChannelBinder`1.InputAsyncResult`1.OnInputComplete(IAsyncResult result)
at System.ServiceModel.Channels.ReliableChannelBinder`1.InputAsyncResult`1.OnInputCompleteStatic(IAsyncResult result)
at System.ServiceModel.Diagnostics.Utility.AsyncThunk.UnhandledExceptionFrame(IAsyncResult result)
at System.ServiceModel.AsyncResult.Complete(Boolean completedSynchronously)
at System.ServiceModel.Channels.InputQueue`1.AsyncQueueReader.Set(Item item)
at System.ServiceModel.Channels.InputQueue`1.Shutdown(CommunicationObject communicationObject)
at System.ServiceModel.Channels.InputQueueChannel`1.OnClosing()
at System.ServiceModel.Channels.CommunicationObject.Abort()
at System.ServiceModel.Channels.ReliableChannelBinder`1.Abort()
at System.ServiceModel.Security.SecuritySessionServerSettings.ServerSecuritySessionChannel.AbortCore()
at System.ServiceModel.Security.SecuritySessionServerSettings.ServerSecuritySimplexSessionChannel.AbortCore()
at System.ServiceModel.Security.SecuritySessionServerSettings.ServerSecuritySimplexSessionChannel.OnAbort()
at System.ServiceModel.Channels.CommunicationObject.Abort()
at System.ServiceModel.Dispatcher.ReplyChannelBinder.Abort()
at System.ServiceModel.Channels.ServiceChannel.OnAbort()
at System.ServiceModel.Channels.CommunicationObject.Abort()
at System.ServiceModel.Channels.ServiceChannel.SessionIdleManager.TimerCallback()
at System.ServiceModel.Channels.ServiceChannel.SessionIdleManager.TimerCallback(Object state)
at System.ServiceModel.Channels.IOThreadScheduler.CriticalHelper.WorkItem.Invoke2()
at System.ServiceModel.Channels.IOThreadScheduler.CriticalHelper.WorkItem.OnSecurityContextCallback(Object o)
at System.Security.SecurityContext.Run(SecurityContext securityContext, ContextCallback callback, Object state)
at System.ServiceModel.Channels.IOThreadScheduler.CriticalHelper.WorkItem.Invoke()
at System.ServiceModel.Channels.IOThreadScheduler.CriticalHelper.ProcessCallbacks()
at System.ServiceModel.Channels.IOThreadScheduler.CriticalHelper.CompletionCallback(Object state)
at System.ServiceModel.Channels.IOThreadScheduler.CriticalHelper.ScheduledOverlapped.IOCallback(UInt32 errorCode, UInt32 numBytes, NativeOverlapped* nativeOverlapped)
at System.ServiceModel.Diagnostics.Utility.IOCompletionThunk.UnhandledExceptionFrame(UInt32 error, UInt32 bytesRead, NativeOverlapped* nativeOverlapped)
at System.Threading._IOCompletionCallback.PerformIOCompletionCallback(UInt32 errorCode, UInt32 numBytes, NativeOverlapped* pOVERLAP)
</StackTrace>
<ExceptionString>System.ServiceModel.CommunicationObjectAbortedException: The communication object, System.ServiceModel.Channels.ReplyChannel, cannot be used for communication because it has been Aborted.</ExceptionString>
</Exception>
</TraceRecord>
</DataItem>
</TraceData>
</ApplicationData>
</E2ETraceEvent>

<E2ETraceEvent xmlns="http://schemas.microsoft.com/2004/06/E2ETraceEvent">
<System xmlns="http://schemas.microsoft.com/2004/06/windows/eventlog/system">
<EventID>131075</EventID>
<Type>3</Type>
<SubType Name="Error">0</SubType>
<Level>2</Level>
<TimeCreated SystemTime="2008-10-06T18:49:18.8257598Z" />
<Source Name="System.ServiceModel" />
<Correlation ActivityID="{dd9e1ee4-57a7-40b4-ac9f-a6cab6cf957e}" />
<Execution ProcessName="Microsoft.MSE.Runtime.ServiceHost" ProcessID="3952" ThreadID="18" />
<Channel />
<Computer>111915-WEB1</Computer>
</System>
<ApplicationData>
<TraceData>
<DataItem>
<TraceRecord xmlns="http://schemas.microsoft.com/2004/10/E2ETraceEvent/TraceRecord" Severity="Error">
<TraceIdentifier>http://msdn.microsoft.com/en-US/library/System.ServiceModel.Diagnostics.ThrowingException.aspx</TraceIdentifier>
<Description>Throwing an exception.</Description>
<AppDomain>Microsoft.MSE.Runtime.ServiceHost.exe</AppDomain>
<Exception>
<ExceptionType>System.ServiceModel.CommunicationObjectAbortedException, System.ServiceModel, Version=3.0.0.0, Culture=neutral, PublicKeyToken=b77a5c561934e089</ExceptionType>
<Message>The communication object, System.ServiceModel.Channels.ReplyChannel, cannot be used for communication because it has been Aborted.</Message>
<StackTrace>
at System.ServiceModel.Channels.CommunicationObject.ThrowIfAborted()
at System.ServiceModel.Channels.ReplyChannel.EndTryReceiveRequest(IAsyncResult result, RequestContext&amp; context)
at System.ServiceModel.Channels.ServerReliableChannelBinder`1.ReplyServerReliableChannelBinder`1.OnEndTryReceive(TReplyChannel channel, IAsyncResult result, RequestContext&amp; requestContext)
at System.ServiceModel.Channels.ReliableChannelBinder`1.TryReceiveAsyncResult.EndInput(ReliableChannelBinder`1 binder, TChannel channel, IAsyncResult result, Boolean&amp; complete)
at System.ServiceModel.Channels.ReliableChannelBinder`1.InputAsyncResult`1.CompleteInput(IAsyncResult result)
at System.ServiceModel.Channels.ReliableChannelBinder`1.InputAsyncResult`1.OnInputComplete(IAsyncResult result)
</StackTrace>
<ExceptionString>System.ServiceModel.CommunicationObjectAbortedException: The communication object, System.ServiceModel.Channels.ReplyChannel, cannot be used for communication because it has been Aborted.
   at System.ServiceModel.Channels.CommunicationObject.ThrowIfAborted()
   at System.ServiceModel.Channels.ReplyChannel.EndTryReceiveRequest(IAsyncResult result, RequestContext&amp; context)
   at System.ServiceModel.Channels.ServerReliableChannelBinder`1.ReplyServerReliableChannelBinder`1.OnEndTryReceive(TReplyChannel channel, IAsyncResult result, RequestContext&amp; requestContext)
   at System.ServiceModel.Channels.ReliableChannelBinder`1.TryReceiveAsyncResult.EndInput(ReliableChannelBinder`1 binder, TChannel channel, IAsyncResult result, Boolean&amp; complete)
   at System.ServiceModel.Channels.ReliableChannelBinder`1.InputAsyncResult`1.CompleteInput(IAsyncResult result)
   at System.ServiceModel.Channels.ReliableChannelBinder`1.InputAsyncResult`1.OnInputComplete(IAsyncResult result)</ExceptionString>
</Exception>
</TraceRecord>
</DataItem>
</TraceData>
</ApplicationData>
</E2ETraceEvent>

<E2ETraceEvent xmlns="http://schemas.microsoft.com/2004/06/E2ETraceEvent">
<System xmlns="http://schemas.microsoft.com/2004/06/windows/eventlog/system">
<EventID>131075</EventID>
<Type>3</Type>
<SubType Name="Error">0</SubType>
<Level>2</Level>
<TimeCreated SystemTime="2008-10-06T18:49:18.8257598Z" />
<Source Name="System.ServiceModel" />
<Correlation ActivityID="{dd9e1ee4-57a7-40b4-ac9f-a6cab6cf957e}" />
<Execution ProcessName="Microsoft.MSE.Runtime.ServiceHost" ProcessID="3952" ThreadID="18" />
<Channel />
<Computer>111915-WEB1</Computer>
</System>
<ApplicationData>
<TraceData>
<DataItem>
<TraceRecord xmlns="http://schemas.microsoft.com/2004/10/E2ETraceEvent/TraceRecord" Severity="Error">
<TraceIdentifier>http://msdn.microsoft.com/en-US/library/System.ServiceModel.Diagnostics.ThrowingException.aspx</TraceIdentifier>
<Description>Throwing an exception.</Description>
<AppDomain>Microsoft.MSE.Runtime.ServiceHost.exe</AppDomain>
<Exception>
<ExceptionType>System.ServiceModel.CommunicationObjectAbortedException, System.ServiceModel, Version=3.0.0.0, Culture=neutral, PublicKeyToken=b77a5c561934e089</ExceptionType>
<Message>The communication object, System.ServiceModel.Channels.ReplyChannel, cannot be used for communication because it has been Aborted.</Message>
<StackTrace>
at System.ServiceModel.AsyncResult.End[TAsyncResult](IAsyncResult result)
at System.ServiceModel.Channels.ReliableChannelBinder`1.InputAsyncResult`1.End()
at System.ServiceModel.Channels.ReliableChannelBinder`1.EndTryReceive(IAsyncResult result, RequestContext&amp; requestContext)
at System.ServiceModel.Security.SecuritySessionServerSettings.ServerSecuritySessionChannel.ReceiveRequestAsyncResult.CompleteReceive(IAsyncResult result)
at System.ServiceModel.Security.SecuritySessionServerSettings.ServerSecuritySessionChannel.ReceiveRequestAsyncResult.OnReceive(IAsyncResult result)
</StackTrace>
<ExceptionString>System.ServiceModel.CommunicationObjectAbortedException: The communication object, System.ServiceModel.Channels.ReplyChannel, cannot be used for communication because it has been Aborted.
   at System.ServiceModel.AsyncResult.End[TAsyncResult](IAsyncResult result)
   at System.ServiceModel.Channels.ReliableChannelBinder`1.InputAsyncResult`1.End()
   at System.ServiceModel.Channels.ReliableChannelBinder`1.EndTryReceive(IAsyncResult result, RequestContext&amp; requestContext)
   at System.ServiceModel.Security.SecuritySessionServerSettings.ServerSecuritySessionChannel.ReceiveRequestAsyncResult.CompleteReceive(IAsyncResult result)
   at System.ServiceModel.Security.SecuritySessionServerSettings.ServerSecuritySessionChannel.ReceiveRequestAsyncResult.OnReceive(IAsyncResult result)</ExceptionString>
<DataItems>
<Data>
<Key>System.ServiceModel.Diagnostics.ExceptionUtility.ExceptionStackAsString</Key>
<Value>throw
   at System.ServiceModel.Channels.CommunicationObject.ThrowIfAborted()
   at System.ServiceModel.Channels.ReplyChannel.EndTryReceiveRequest(IAsyncResult result, RequestContext&amp; context)
   at System.ServiceModel.Channels.ServerReliableChannelBinder`1.ReplyServerReliableChannelBinder`1.OnEndTryReceive(TReplyChannel channel, IAsyncResult result, RequestContext&amp; requestContext)
   at System.ServiceModel.Channels.ReliableChannelBinder`1.TryReceiveAsyncResult.EndInput(ReliableChannelBinder`1 binder, TChannel channel, IAsyncResult result, Boolean&amp; complete)
   at System.ServiceModel.Channels.ReliableChannelBinder`1.InputAsyncResult`1.CompleteInput(IAsyncResult result)
   at System.ServiceModel.Channels.ReliableChannelBinder`1.InputAsyncResult`1.OnInputComplete(IAsyncResult result)
catch
</Value>
</Data>
</DataItems>
</Exception>
</TraceRecord>
</DataItem>
</TraceData>
</ApplicationData>
</E2ETraceEvent>

Developer
Oct 8, 2008 at 2:03 PM

The error appears to be with a problem loading the Channel Moniker.  This is the XAML where the Address and Action are usually specified at the OperationVersion level.  The XAML Parser isn't able to deserialize the xml into an object graph.

Have you created a custom Channel Moniker?

Oct 8, 2008 at 2:11 PM
Thanks for the quick response.

No, we haven't created a custom Channel Moniker.  Would you expect the error you described to occur consistently?  Right now the issue is sporadic and probably occurs 30-40% of the time.
Developer
Oct 9, 2008 at 3:13 PM
Normally yes, I'd expect that error to occur consistently if there was something wrong with the Channel Moniker. 

Can you provide some more context to when this error occurs?
  Does this happen during high volume only?
  Does it occur only when there is certain other activity going on on the machine?
  What bindings are used by the MSE hosted endpoint and the service implementation?
  What size are the messages being exchanged?
  Is there load balancing involved either in front of the MSE endpoint or the service implementation?

Thanks.
Oct 10, 2008 at 1:35 PM
Does this happen during high volume only?
- No, this doesn't appear to be volume related.  We see the same percentage of errors regardless of how many calls are made to the service.

Does it occur only when there is certain other activity going on on the machine?
- We're looking into this.

What bindings are used by the MSE hosted endpoint and the service implementation?
Is there load balancing involved either in front of the MSE endpoint or the service implementation
?

- There are 2 MSE endpoints involved.  Endpoint 1 is publicly exposed with a wsHttpBinding on two load balanced web servers, Web1 and Web2.  The endpoint has message security with username credentials.  This endpoint exposes Service 1 which is a WCF windows service using a netTcpBinding on a single application server.  Service 1 has no security in place.

During its processing, Service 1 will call into a second endpoint, Endpoint 2.  Endpoint 2 is hosted on the same application server and uses a netTcpBinding with no security.  It exposes another WCF windows service, Service 2, which uses a netTcpBinding with no security.

The error occurs in the runtime servers on Web1 and Web2.  When it occurs we don't see any activity on the app server.

What size are the messages being exchanged?
Most of the messages are less than 10 KB.  The largest messages top out around 200-300 KB, but these are rare.


We've also seen the following exception in our trace logs numerous times:

"The socket connection was aborted. This could be caused by an error processing your message or a receive timeout being exceeded by the remote host, or an underlying network resource issue. Local socket timeout was '00:00:30.0000001'."

This seems to occur when Service 1 is calling Endpoint 2.  Calls will go through fine and we won't see this exception for a while.  But if the system goes a few minutes without a call from Service 1 to Endponit 2, we'll see this exception on the next call.  This doesn't appear to interfere with our processing at all, as both request and response are handled as expected.  The only way we've found to eliminate this error is to switch all netTcp bindings to Http, but this hasn't been done in production.  Could this be at all related to the "Error in BeginRequest" message?

Thanks for your help.
Oct 10, 2008 at 3:30 PM
Regarding the socket connection issue, it looks like this exception is avoided if we explicitly close the ChannelFactory after making a call to a service using a netTcpBinding.  This is in addition to wrapping the client proxy in a using statement.  This works calling the MSE endpoint or calling the underlying service directly.  I don't know if this will have any impact on our "Error in BeginRequest" issue.

using

(ServiceClient client = new ServiceClient())
{
    client.DoSomething(request);
    client.ChannelFactory.Close();
}

 

Oct 20, 2008 at 10:22 PM
This "Error in BeginRequest" message continues to give us issues.  Does anyone have a suggestion as to what might be causing this?