Failed jobs do not become expired to allow you to re-queue them without any
time pressure. You should re-queue or delete them manually, or apply AutomaticRetry(OnAttemptsExceeded = AttemptsExceededAction.Delete)
attribute to delete them automatically.
An exception occurred during performance of the job. Fewer details...
03/30/2026 00:00:10
System.Net.Http.HttpRequestException
Response status code does not indicate success: 422 (Unprocessable Entity).
System.Net.Http.HttpRequestException: Response status code does not indicate success: 422 (Unprocessable Entity).
at System.Net.Http.HttpResponseMessage.EnsureSuccessStatusCode()
at MR.Schedules.CreateApproversReminderNotificationsTask.StartJobCreateApproversReminderNotifications() in /home/azureuser/sn1/src/BackEnd/MR.Schedules/Tasks/CreateApproversReminderNotificationsTask.cs:line 35
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Objectobj, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
03/29/2026 00:00:21
System.Net.Http.HttpRequestException
Response status code does not indicate success: 422 (Unprocessable Entity).
System.Net.Http.HttpRequestException: Response status code does not indicate success: 422 (Unprocessable Entity).
at System.Net.Http.HttpResponseMessage.EnsureSuccessStatusCode()
at MR.Schedules.CreateApproversReminderNotificationsTask.StartJobCreateApproversReminderNotifications() in /home/azureuser/sn1/src/BackEnd/MR.Schedules/Tasks/CreateApproversReminderNotificationsTask.cs:line 35
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Objectobj, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
03/28/2026 01:30:51
System.InvalidOperationException
An invalid request URI was provided. Either the request URI must be an absolute URI or BaseAddress must be set.
System.InvalidOperationException: An invalid request URI was provided. Either the request URI must be an absolute URI or BaseAddress must be set.
at System.Net.Http.HttpClient.PrepareRequestMessage(HttpRequestMessagerequest)
at System.Net.Http.HttpClient.SendAsync(HttpRequestMessagerequest, HttpCompletionOptioncompletionOption, CancellationTokencancellationToken)
at MR.Schedules.AssignmentsApplyTenureRateDropOffTask.AssignmentsApplyTenureRateDropOffJob() in /home/azureuser/sn1/src/BackEnd/MR.Schedules/Tasks/AssignmentsApplyTenureRateDropOffTask.cs:line 29
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Objectobj, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
03/28/2026 01:27:53
System.Net.Http.HttpRequestException
Connection refused (staging.sourcenowvms.com:443)
System.Net.Http.HttpRequestException: Connection refused (staging.sourcenowvms.com:443)
---> System.Net.Sockets.SocketException (111): Connection refused
at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.ThrowException(SocketErrorerror, CancellationTokencancellationToken)
at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.System.Threading.Tasks.Sources.IValueTaskSource.GetResult(Int16token)
at System.Net.Sockets.Socket.<ConnectAsync>g__WaitForConnectWithCancellation|285_0(AwaitableSocketAsyncEventArgssaea, ValueTaskconnectTask, CancellationTokencancellationToken)
at System.Net.Http.HttpConnectionPool.ConnectToTcpHostAsync(Stringhost, Int32port, HttpRequestMessageinitialRequest, Booleanasync, CancellationTokencancellationToken)
--- End of inner exception stack trace ---
at System.Net.Http.HttpConnectionPool.ConnectToTcpHostAsync(Stringhost, Int32port, HttpRequestMessageinitialRequest, Booleanasync, CancellationTokencancellationToken)
at System.Net.Http.HttpConnectionPool.ConnectAsync(HttpRequestMessagerequest, Booleanasync, CancellationTokencancellationToken)
at System.Net.Http.HttpConnectionPool.CreateHttp11ConnectionAsync(HttpRequestMessagerequest, Booleanasync, CancellationTokencancellationToken)
at System.Net.Http.HttpConnectionPool.InjectNewHttp11ConnectionAsync(QueueItemqueueItem)
at System.Threading.Tasks.TaskCompletionSourceWithCancellation`1.WaitWithCancellationAsync(CancellationTokencancellationToken)
at System.Net.Http.HttpConnectionPool.SendWithVersionDetectionAndRetryAsync(HttpRequestMessagerequest, Booleanasync, BooleandoRequestAuth, CancellationTokencancellationToken)
at System.Net.Http.RedirectHandler.SendAsync(HttpRequestMessagerequest, Booleanasync, CancellationTokencancellationToken)
at System.Net.Http.HttpClient.<SendAsync>g__Core|83_0(HttpRequestMessagerequest, HttpCompletionOptioncompletionOption, CancellationTokenSourcects, BooleandisposeCts, CancellationTokenSourcependingRequestsCts, CancellationTokenoriginalCancellationToken)
at MR.Schedules.DeleteDraftJobsTask.StartDeleteDraftJobs() in /home/azureuser/sn1/src/BackEnd/MR.Schedules/Tasks/DeleteDraftJobsTask.cs:line 37
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Objectobj, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
03/28/2026 00:00:08
System.Net.Http.HttpRequestException
Response status code does not indicate success: 422 (Unprocessable Entity).
System.Net.Http.HttpRequestException: Response status code does not indicate success: 422 (Unprocessable Entity).
at System.Net.Http.HttpResponseMessage.EnsureSuccessStatusCode()
at MR.Schedules.CreateApproversReminderNotificationsTask.StartJobCreateApproversReminderNotifications() in /home/azureuser/sn1/src/BackEnd/MR.Schedules/Tasks/CreateApproversReminderNotificationsTask.cs:line 35
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Objectobj, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
03/27/2026 12:01:01
System.InvalidOperationException
Could not get a value of the job parameter `CurrentCulture`. See inner exception for details.
System.InvalidOperationException: Could not get a value of the job parameter `CurrentCulture`. See inner exception for details.
---> Npgsql.PostgresException (0x80004005): 53300: sorry, too many clients already
at Npgsql.Internal.NpgsqlConnector.<ReadMessage>g__ReadMessageLong|213_0(NpgsqlConnectorconnector, Booleanasync, DataRowLoadingModedataRowLoadingMode, BooleanreadingNotifications, BooleanisReadingPrependedMessage)
at Npgsql.Internal.NpgsqlConnector.Authenticate(Stringusername, NpgsqlTimeouttimeout, Booleanasync, CancellationTokencancellationToken)
at Npgsql.Internal.NpgsqlConnector.<Open>g__OpenCore|193_1(NpgsqlConnectorconn, SslModesslMode, NpgsqlTimeouttimeout, Booleanasync, CancellationTokencancellationToken)
at Npgsql.Internal.NpgsqlConnector.Open(NpgsqlTimeouttimeout, Booleanasync, CancellationTokencancellationToken)
at Npgsql.ConnectorPool.OpenNewConnector(NpgsqlConnectionconn, NpgsqlTimeouttimeout, Booleanasync, CancellationTokencancellationToken)
at Npgsql.ConnectorPool.<Get>g__RentAsync|31_0(NpgsqlConnectionconn, NpgsqlTimeouttimeout, Booleanasync, CancellationTokencancellationToken)
at Npgsql.NpgsqlConnection.<Open>g__OpenAsync|45_0(Booleanasync, CancellationTokencancellationToken)
at Npgsql.NpgsqlConnection.Open()
at Hangfire.PostgreSql.PostgreSqlStorage.CreateAndOpenConnection()
at Hangfire.PostgreSql.PostgreSqlStorage.UseConnection[T](DbConnectiondedicatedConnection, Func`2func)
at Hangfire.PostgreSql.PostgreSqlConnection.GetJobParameter(Stringid, Stringname)
at Hangfire.Server.PerformContext.GetJobParameter[T](Stringname, BooleanallowStale)
Exception data:
Severity: FATAL
SqlState: 53300
MessageText: sorry, too many clients already
File: proc.c
Line: 360
Routine: InitProcess
--- End of inner exception stack trace ---
at Hangfire.Server.PerformContext.GetJobParameter[T](Stringname, BooleanallowStale)
at Hangfire.CaptureCultureAttribute.OnPerforming(PerformingContextcontext)
at Hangfire.Profiling.ProfilerExtensions.InvokeAction[TInstance](InstanceAction`1tuple)
at Hangfire.Profiling.SlowLogProfiler.InvokeMeasured[TInstance,TResult](TInstanceinstance, Func`2action, Stringmessage)
at Hangfire.Profiling.ProfilerExtensions.InvokeMeasured[TInstance](IProfilerprofiler, TInstanceinstance, Action`1action, Stringmessage)
at Hangfire.Server.BackgroundJobPerformer.InvokePerformFilter(IServerFilterfilter, PerformingContextpreContext, Func`1continuation)
An exception occurred during performance of the job. More details...
03/27/2026 00:00:11
System.Net.Http.HttpRequestException
Response status code does not indicate success: 422 (Unprocessable Entity).
System.Net.Http.HttpRequestException: Response status code does not indicate success: 422 (Unprocessable Entity).
at System.Net.Http.HttpResponseMessage.EnsureSuccessStatusCode()
at MR.Schedules.CreateApproversReminderNotificationsTask.StartJobCreateApproversReminderNotifications() in /home/azureuser/sn1/src/BackEnd/MR.Schedules/Tasks/CreateApproversReminderNotificationsTask.cs:line 35
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Objectobj, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
03/26/2026 23:15:02
System.Net.Http.HttpRequestException
Connection refused (staging.sourcenowvms.com:443)
System.Net.Http.HttpRequestException: Connection refused (staging.sourcenowvms.com:443)
---> System.Net.Sockets.SocketException (111): Connection refused
at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.ThrowException(SocketErrorerror, CancellationTokencancellationToken)
at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.System.Threading.Tasks.Sources.IValueTaskSource.GetResult(Int16token)
at System.Net.Sockets.Socket.<ConnectAsync>g__WaitForConnectWithCancellation|285_0(AwaitableSocketAsyncEventArgssaea, ValueTaskconnectTask, CancellationTokencancellationToken)
at System.Net.Http.HttpConnectionPool.ConnectToTcpHostAsync(Stringhost, Int32port, HttpRequestMessageinitialRequest, Booleanasync, CancellationTokencancellationToken)
--- End of inner exception stack trace ---
at System.Net.Http.HttpConnectionPool.ConnectToTcpHostAsync(Stringhost, Int32port, HttpRequestMessageinitialRequest, Booleanasync, CancellationTokencancellationToken)
at System.Net.Http.HttpConnectionPool.ConnectAsync(HttpRequestMessagerequest, Booleanasync, CancellationTokencancellationToken)
at System.Net.Http.HttpConnectionPool.CreateHttp11ConnectionAsync(HttpRequestMessagerequest, Booleanasync, CancellationTokencancellationToken)
at System.Net.Http.HttpConnectionPool.InjectNewHttp11ConnectionAsync(QueueItemqueueItem)
at System.Threading.Tasks.TaskCompletionSourceWithCancellation`1.WaitWithCancellationAsync(CancellationTokencancellationToken)
at System.Net.Http.HttpConnectionPool.SendWithVersionDetectionAndRetryAsync(HttpRequestMessagerequest, Booleanasync, BooleandoRequestAuth, CancellationTokencancellationToken)
at System.Net.Http.RedirectHandler.SendAsync(HttpRequestMessagerequest, Booleanasync, CancellationTokencancellationToken)
at System.Net.Http.HttpClient.<SendAsync>g__Core|83_0(HttpRequestMessagerequest, HttpCompletionOptioncompletionOption, CancellationTokenSourcects, BooleandisposeCts, CancellationTokenSourcependingRequestsCts, CancellationTokenoriginalCancellationToken)
at MR.Schedules.SendNotificationsTask.StartJobSendNotifications() in /home/azureuser/sn1/src/BackEnd/MR.Schedules/Tasks/SendNotificationsTask.cs:line 36
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Objectobj, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
03/26/2026 23:11:01
System.Net.Http.HttpRequestException
Response status code does not indicate success: 502 (Bad Gateway).
System.Net.Http.HttpRequestException: Response status code does not indicate success: 502 (Bad Gateway).
at System.Net.Http.HttpResponseMessage.EnsureSuccessStatusCode()
at MR.Schedules.DeleteDraftJobsTask.StartDeleteDraftJobs() in /home/azureuser/sn1/src/BackEnd/MR.Schedules/Tasks/DeleteDraftJobsTask.cs:line 38
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Objectobj, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
03/26/2026 23:11:01
System.Net.Http.HttpRequestException
Response status code does not indicate success: 502 (Bad Gateway).
System.Net.Http.HttpRequestException: Response status code does not indicate success: 502 (Bad Gateway).
at System.Net.Http.HttpResponseMessage.EnsureSuccessStatusCode()
at MR.Schedules.SendNotificationsTask.StartJobSendNotifications() in /home/azureuser/sn1/src/BackEnd/MR.Schedules/Tasks/SendNotificationsTask.cs:line 37
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Objectobj, BindingFlagsinvokeAttr)