Too much delay in loading Releases - RavenDB accute slowness

rjayakumar

We are getting extreme slowness from RavenDB as it either times out else does't load the releases in to the drop down. This is becoming a bottle neck.
We do archive the release packages weekly (manually done to a separate folder) to minimize the load time.

Below is the information from DM.

The following error occurred:
Waited for 15,089ms for the query to return non stale result.

If you contact Red Gate, the following information can help us to understand the error:

System.TimeoutException: Waited for 15,089ms for the query to return non stale result.
at Raven.Client.Document.SessionOperations.QueryOperation.IsAcceptable(QueryResult result)
at Raven.Client.Document.AbstractDocumentQuery`2.ExecuteActualQuery()
at Raven.Client.Document.AbstractDocumentQuery`2.get_QueryResult()
at Raven.Client.Linq.RavenQueryProviderProcessor`1.ExecuteQuery[TProjection]()
at Raven.Client.Linq.RavenQueryInspector`1.GetEnumerator()
at System.Collections.Generic.List`1..ctor(IEnumerable`1 collection)
at System.Linq.Enumerable.ToList[TSource](IEnumerable`1 source)
at RedGate.Deploy.Portal.Models.Projects.ProjectDetailsModelBuilder.CreateFrom(Project project, DmPrincipal principal)
at RedGate.Deploy.Portal.Controllers.ProjectsController.Show(String slug)
at lambda_method(Closure , ControllerBase , Object[] )
at System.Web.Mvc.ReflectedActionDescriptor.Execute(ControllerContext controllerContext, IDictionary`2 parameters)
at System.Web.Mvc.ControllerActionInvoker.InvokeActionMethod(ControllerContext controllerContext, ActionDescriptor actionDescriptor, IDictionary`2 parameters)
at System.Web.Mvc.ControllerActionInvoker.<>c__DisplayClass15.<InvokeActionMethodWithFilters>b__12()
at System.Web.Mvc.ControllerActionInvoker.InvokeActionMethodFilter(IActionFilter filter, ActionExecutingContext preContext, Func`1 continuation)
at System.Web.Mvc.ControllerActionInvoker.InvokeActionMethodFilter(IActionFilter filter, ActionExecutingContext preContext, Func`1 continuation)
at System.Web.Mvc.ControllerActionInvoker.InvokeActionMethodWithFilters(ControllerContext controllerContext, IList`1 filters, ActionDescriptor actionDescriptor, IDictionary`2 parameters)
at System.Web.Mvc.ControllerActionInvoker.InvokeAction(ControllerContext controllerContext, String actionName)

Mike U

This sounds like a corrupt index in the underlying database (RavenDB). If you remote to the DM server and then use a browser to navigate to http://localhost:10300/raven/studio.html#/status?database=%3Csystem%3E, are there any Stale Indexes listed? Also, on the left hand side of that page you should see 'Index Errors' - if you click on it, are there any errors listed?

By the way, could you also confirm what version of Deployment Manager you are using?

rjayakumar

Thanks Mike.

Just verified as advised by you. It says 0 index errors.
Let me know if you need further information and I shall be happy to assist.

The DM version is Pro Edition v2.4.12.1

Mike U

And were there any stale indexes?

rjayakumar

No.

Below is a quick look.

LastDocEtag 01000000-0000-0031-0000-0000000005C6
LastAttachmentEtag 02000000-0000-0031-0000-0000000002CD
CountOfindexes 25
Cour,tOfDocuments 3,129
Staleindexes No Stale Indexes
CurrentNumberOfltemsrolndexlnSíngie Batch 2,048
CurrentNumberOfltemsToReducelnSingleßatch 512
DatabaseTransactionversionSizelnMß 0.06
Indexes
DeploymentsByTaskld
IndexingAttenipts 52,115
Indexingsuccesses 52,115
LastlndexedEtag 01000000-0000-0031-0000-0000000005C6
LastlndexedTirnestamp 8/21/2014 2:58:14 PM
LastQueryTirnestamp 9/17/2013 11:05:29 AM
Priority Normal
CreatedTimestanip 1/1/0001 5:30:00 AM