Is your feature request related to a problem? Please describe. We've migrated this repo between various organizations many times, somehow we lost contributes' information, the GitHub right panel of the project home page only shows 7 contributors, however, there are more than 20

Describe the solution you'd like Use all-contributors bot to add all contributors

https://github.com/thoughtworks/metrik/issues/95 Divide the fetching progress into 3 "steps" and show: fetching new runs, fetching in-progress runs and fetching commits. Remove redundant emitCb during mapping of runs and commits. Fix the problem of SSE cached due to the webpack. Fix the problem of tests' name and services' name don't match.

Describe the context of this enhancement For some CI/CD systems, i.e. Github Actions, the synchronization has two parts: sync pipeline executions and sync commit history, both of them cost much time. The current implementation of progress notification can't handle a situation like this.

Describe the solution you'd like Use segmented progress, e.g. 50% for executions sync and 50% for commit sync

Our team fix sync failed error when fetching commits of deleted branch as the following ideas: https://github.com/thoughtworks/metrik/issues/114#issuecomment-1140765521

Also, we refactor GithubPipelineService following the picture below:

We extract several services from GithubPipelineService to make it independent. Thus, we add some unit tests according to new services and fix GithubPipelineServiceTest.

1. Based on historical commit, recovered the horizontal scrollbar when data is a lot
2. Fix the flashing issue about scrollbars
3. Fix the console warning about width attribute with negative value

Current fixed look:

Describe the bug Synchronize failed while fetching commits of deleted branch in Github

To Reproduce Steps to reproduce the behavior:

1. Add a Github Actions project in which a branch is deleted after merging its commits
2. See error

Expected behavior Synchronize should work and able to see metrics

Desktop (please complete the following information):

• OS: MAC
• Browser: chrome
• Version: HEAD

Error thrown ERROR 2022-05-15 09:36:11.299 traceId: --- [pool-2-thread-1] m.p.r.a.SynchronizationApplicationService:Synchronize failed for pipeline [627ff5a82a30707ac0e4ed11 - ordermanagement], error: [feign.codec.DecodeException: Error while extracting response for type [java.util.List<metrik.project.infrastructure.github.feign.response.CommitResponse>] and content type [application/json;charset=utf-8]; nested exception is org.springframework.http.converter.HttpMessageNotReadableException: JSON parse error: Cannot deserialize instance of java.util.ArrayList<metrik.project.infrastructure.github.feign.response.CommitResponse> out of START_OBJECT token; nested exception is com.fasterxml.jackson.databind.exc.MismatchedInputException: Cannot deserialize instance of java.util.ArrayList<metrik.project.infrastructure.github.feign.response.CommitResponse> out of START_OBJECT token at [Source: (PushbackInputStream); line: 1, column: 1]] Exception in thread "pool-2-thread-1" metrik.project.exception.SynchronizationException: Synchronize failed at metrik.project.rest.applicationservice.SynchronizationApplicationService$synchronize$1.accept(SynchronizationApplicationService.kt:39) at metrik.project.rest.applicationservice.SynchronizationApplicationService$synchronize$1.accept(SynchronizationApplicationService.kt:14) at java.base/java.util.stream.ForEachOps$ForEachOp$OfRef.accept(ForEachOps.java:183) at java.base/java.util.ArrayList$ArrayListSpliterator.forEachRemaining(ArrayList.java:1655) at java.base/java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:484) at java.base/java.util.stream.ForEachOps$ForEachTask.compute(ForEachOps.java:290) at java.base/java.util.concurrent.CountedCompleter.exec(CountedCompleter.java:746) at java.base/java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:290) at java.base/java.util.concurrent.ForkJoinTask.doInvoke(ForkJoinTask.java:408) at java.base/java.util.concurrent.ForkJoinTask.invoke(ForkJoinTask.java:736) at java.base/java.util.stream.ForEachOps$ForEachOp.evaluateParallel(ForEachOps.java:159) at java.base/java.util.stream.ForEachOps$ForEachOp$OfRef.evaluateParallel(ForEachOps.java:173) at java.base/java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:233) at java.base/java.util.stream.ReferencePipeline.forEach(ReferencePipeline.java:497) at java.base/java.util.stream.ReferencePipeline$Head.forEach(ReferencePipeline.java:661) at metrik.project.rest.applicationservice.SynchronizationApplicationService.synchronize(SynchronizationApplicationService.kt:34) at metrik.project.rest.applicationservice.SynchronizationApplicationService$$FastClassBySpringCGLIB$$e40c75eb.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:687) at metrik.project.rest.applicationservice.SynchronizationApplicationService$$EnhancerBySpringCGLIB$$ff0f05fc.synchronize() at metrik.project.rest.SynchronizationController$sseSynchronization$1.run(SynchronizationController.kt:53) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) at java.base/java.lang.Thread.run(Thread.java:834)

Hello Awesome Team,

Describe the bug

When using persistent volume (Azure File Share/ Azure Disk) on AKS Cluster, the application failed to read the Git hub data, it kept on synchronizing but never loaded any data.

However if we deploy the application on AKS, with out any external volume mount, it works fine.

To Reproduce

SetUp

1. Create a Storage class (Azure File Share) on AKS Cluster

2. Create a PVC (Persistent Volume Claim)

3. Create a deployment and mount the /data/db on the above created PVC

4. Create a load balancer service for accessing the application.

5. Access the application using load balancer IP,

6. Create a new project and configure with GITHUB repo using PAT tokens.

Expected behavior

The application would have loaded the GITHUB data and display the charts.

Screenshots

Cluster Information

K8s Version : 1.20.7 Cloud Provider : Azure Persistent Volume : Azure File Share / Azure Disk

How to do

1. remove button in ConfigSuccess div
2. add button in ProjectConfig
3. add showReloadCTA param to cover button show logic(only configSuccess call )

this fixes an exception which appears when a branch name is passed into the api request to the sha query parameter. Fixed to be consistent witch parameters and values to branch, usage of sha would only get a single commit.

Hello Team,

With the recent Log4j vulnerability, we have found that the current release of the docker image for Dora Metrics has issues.

Are we planning to update the docker images with the latest upgrade(log4j)/ fix for the issue.

Many thanks, Mohammed

Describe the bug A clear and concise description of what the bug is. I am able to integrate the tool with Jenkins pipeline. However when I go to dashboard, I get an error "Handler dispatch failed; nested exception is kotlin.NotImplementedError: An operation is not implemented: Not yet implemented".

Expected behavior Expected to see the metrics data

Screenshots

Desktop (please complete the following information):

• OS: Mac Big Sur
• Browser Brave
• Version 1.23.75

Describe the bug

1. Start the container: docker run -d -p 80:80 --name metrik public.ecr.aws/j2s5d3z8/4-key-metrics:latest
2. Configure a Github Action Pipeline for small project. Works
3. Configure a Github Action Pipeline for project with lots of activity. Doesnt work

To Reproduce I guess to reproduce just use a big project. The current project it is failing on has 40 branches and over 11k commits

Expected behavior Show the data for big project

Desktop (please complete the following information):

• OS: MacOS
• Browser n/a
• Version n/a

Additional context Add any other context about the problem here.

INFO 2022-12-21 01:36:07.368 traceId: --- [pool-25-thread-1] m.p.d.s.g.CommitService:Get Github Commits - Sending request to Github Feign Client with owner: https://api.github.com/repos/ORG/REPO, since: 1970-01-01T08:00, until: 2022-12-20T23:46:41, branch: EPIC-XXX/OMITED, pageIndex: 79
ERROR 2022-12-21 01:36:07.485 traceId:a8d88d43711058d9 --- [http-nio-9000-exec-8] m.e.GlobalExceptionHandler:Unexpected exception happened with error message: null
org.springframework.web.context.request.async.AsyncRequestTimeoutException
	at org.springframework.web.context.request.async.TimeoutDeferredResultProcessingInterceptor.handleTimeout(TimeoutDeferredResultProcessingInterceptor.java:42)
	at org.springframework.web.context.request.async.DeferredResultInterceptorChain.triggerAfterTimeout(DeferredResultInterceptorChain.java:79)
	at org.springframework.web.context.request.async.WebAsyncManager.lambda$startDeferredResultProcessing$5(WebAsyncManager.java:438)
	at java.base/java.util.ArrayList.forEach(Unknown Source)
	at org.springframework.web.context.request.async.StandardServletAsyncWebRequest.onTimeout(StandardServletAsyncWebRequest.java:151)
	at org.apache.catalina.core.AsyncListenerWrapper.fireOnTimeout(AsyncListenerWrapper.java:44)
	at org.apache.catalina.core.AsyncContextImpl.timeout(AsyncContextImpl.java:136)
	at org.apache.catalina.connector.CoyoteAdapter.asyncDispatch(CoyoteAdapter.java:153)
	at org.apache.coyote.AbstractProcessor.dispatch(AbstractProcessor.java:241)
	at org.apache.coyote.AbstractProcessorLight.process(AbstractProcessorLight.java:59)
	at org.apache.coyote.AbstractProtocol$ConnectionHandler.process(AbstractProtocol.java:888)
	at org.apache.tomcat.util.net.NioEndpoint$SocketProcessor.doRun(NioEndpoint.java:1597)
	at org.apache.tomcat.util.net.SocketProcessorBase.run(SocketProcessorBase.java:49)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
	at org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61)
	at java.base/java.lang.Thread.run(Unknown Source)
WARN 2022-12-21 01:36:07.486 traceId:a8d88d43711058d9 --- [http-nio-9000-exec-8] o.s.w.s.m.m.a.ExceptionHandlerExceptionResolver:Failure in @ExceptionHandler metrik.exception.GlobalExceptionHandler#handleThrowable(Throwable)
org.springframework.http.converter.HttpMessageNotWritableException: No converter for [class metrik.exception.ErrorResponse] with preset Content-Type 'text/event-stream'
	at org.springframework.web.servlet.mvc.method.annotation.AbstractMessageConverterMethodProcessor.writeWithMessageConverters(AbstractMessageConverterMethodProcessor.java:299)
	at org.springframework.web.servlet.mvc.method.annotation.HttpEntityMethodProcessor.handleReturnValue(HttpEntityMethodProcessor.java:219)
	at org.springframework.web.method.support.HandlerMethodReturnValueHandlerComposite.handleReturnValue(HandlerMethodReturnValueHandlerComposite.java:78)
	at org.springframework.web.servlet.mvc.method.annotation.ServletInvocableHandlerMethod.invokeAndHandle(ServletInvocableHandlerMethod.java:124)
	at org.springframework.web.servlet.mvc.method.annotation.ExceptionHandlerExceptionResolver.doResolveHandlerMethodException(ExceptionHandlerExceptionResolver.java:424)
	at org.springframework.web.servlet.handler.AbstractHandlerMethodExceptionResolver.doResolveException(AbstractHandlerMethodExceptionResolver.java:75)
	at org.springframework.web.servlet.handler.AbstractHandlerExceptionResolver.resolveException(AbstractHandlerExceptionResolver.java:141)
	at org.springframework.web.servlet.handler.HandlerExceptionResolverComposite.resolveException(HandlerExceptionResolverComposite.java:80)
	at org.springframework.web.servlet.DispatcherServlet.processHandlerException(DispatcherServlet.java:1321)
	at org.springframework.web.servlet.DispatcherServlet.processDispatchResult(DispatcherServlet.java:1132)
	at org.springframework.web.servlet.DispatcherServlet.doDispatch(DispatcherServlet.java:1078)
	at org.springframework.web.servlet.DispatcherServlet.doService(DispatcherServlet.java:961)
	at org.springframework.web.servlet.FrameworkServlet.processRequest(FrameworkServlet.java:1006)
	at org.springframework.web.servlet.FrameworkServlet.doGet(FrameworkServlet.java:898)
	at javax.servlet.http.HttpServlet.service(HttpServlet.java:626)
	at org.springframework.web.servlet.FrameworkServlet.service(FrameworkServlet.java:883)
	at javax.servlet.http.HttpServlet.service(HttpServlet.java:733)
	at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:231)
	at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:166)
	at org.springframework.web.filter.RequestContextFilter.doFilterInternal(RequestContextFilter.java:100)
	at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:119)
	at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:193)
	at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:166)
	at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:103)
	at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:193)
	at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:166)
	at org.springframework.cloud.sleuth.instrument.web.servlet.TracingFilter.doFilter(TracingFilter.java:68)
	at org.springframework.cloud.sleuth.autoconfig.instrument.web.LazyTracingFilter.doFilter(TraceWebServletConfiguration.java:121)
	at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:193)
	at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:166)
	at org.springframework.boot.actuate.metrics.web.servlet.WebMvcMetricsFilter.doFilterInternal(WebMvcMetricsFilter.java:93)
	at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:119)
	at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:193)
	at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:166)
	at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:103)
	at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:193)
	at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:166)
	at org.apache.catalina.core.ApplicationDispatcher.invoke(ApplicationDispatcher.java:712)
	at org.apache.catalina.core.ApplicationDispatcher.doDispatch(ApplicationDispatcher.java:633)
	at org.apache.catalina.core.ApplicationDispatcher.dispatch(ApplicationDispatcher.java:601)
	at org.apache.catalina.core.AsyncContextImpl$AsyncRunnable.run(AsyncContextImpl.java:586)
	at org.apache.catalina.core.AsyncContextImpl.doInternalDispatch(AsyncContextImpl.java:354)
	at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:199)
	at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:97)
	at org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:542)
	at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:143)
	at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:92)
	at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:78)
	at org.apache.catalina.connector.CoyoteAdapter.asyncDispatch(CoyoteAdapter.java:235)
	at org.apache.coyote.AbstractProcessor.dispatch(AbstractProcessor.java:241)
	at org.apache.coyote.AbstractProcessorLight.process(AbstractProcessorLight.java:59)
	at org.apache.coyote.AbstractProtocol$ConnectionHandler.process(AbstractProtocol.java:888)
	at org.apache.tomcat.util.net.NioEndpoint$SocketProcessor.doRun(NioEndpoint.java:1597)
	at org.apache.tomcat.util.net.SocketProcessorBase.run(SocketProcessorBase.java:49)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
	at org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61)
	at java.base/java.lang.Thread.run(Unknown Source)
WARN 2022-12-21 01:36:07.486 traceId:a8d88d43711058d9 --- [http-nio-9000-exec-8] o.s.w.s.m.s.DefaultHandlerExceptionResolver:Async request timed out
WARN 2022-12-21 01:36:07.486 traceId:a8d88d43711058d9 --- [http-nio-9000-exec-8] o.s.w.s.m.s.DefaultHandlerExceptionResolver:Resolved [org.springframework.web.context.request.async.AsyncRequestTimeoutException]
INFO 2022-12-21 01:36:08.088 traceId: --- [pool-25-thread-1] m.p.d.s.g.CommitService:Get Github Commits - Sending request to Github Feign Client with owner: https://api.github.com/repos/ORG/REPO, since: 1970-01-01T08:00, until: 2022-12-20T23:46:41, branch: EPIC-XXXXX/OMITED, pageIndex: 80

After failing it will restart, successfully pull the information from the small repository then fail again on the big one.

Describe the context of this enhancement Hi, I know there are several places that document the process of running the app locally (from backend, frontend, and ci folder). But I don't see there's a comprehensive step-by-step to build the app into a docker image and eventually run the app.

Describe the solution you'd like A centralized content on how to build the app from scratch (backend & frontend) until the process of docker build and docker run so that we can run the app with ease without running the components (backend, frontend, DB) individually.

Additional context So far, here's what I've done to build the app from scratch:

• build the frontend app (by running npm run build:prod)
• build the backend app (by running ./gradlew clean build)
• collect artifacts (by following the steps here)
• build the docker image by running docker build -t <docker-image-name>.
• finally, run the container by running docker run -d -p 3000:80 --name <container-name> <docker-image-name>:latest

But the above method didn't work as the app has been returning 502 Bad Gateway. So I'd appreciate if there's any pointer on what went wrong from the above steps 🙇

Thank you very much!

Hello

I started experimenting with metrik and wanted to ask you how lead time for changes metrik is calculated. In the last 18 days, I had 3 deployments to production in my GitHub organization. When I adjusted the dates in the metrik ui to cover those periods and set the workflow name to the production deployment workflow, I see the following charts. How can the lead time to change metric in the last 20 days be equal to 88 days? Any help is appreciated.

Describe the context of this enhancement This request relates to documentation and the ability to guide a user on how to integrate metrik in an existing application. As a technical lead, I would like to integrate metrik with a real-world full-stack application, however, I don't have enough documentation showing how to do it.

Describe the solution you'd like Ideally the solution shall provide an example with a full-stack application with GitHub as the source control and any cloud provider such as AWS. The documentation shall show how to integrate with metrik and provide examples show the various metrics such as deployment frequency, lead time etc.

Additional context The idea would be to build up something similar to the Cypress Real World app https://github.com/cypress-io/cypress-realworld-app which in that case provides examples on how to integrate with different auth providers.

Describe the context of this enhancement Currently for Github Actions project, by default for backend it will fetch all workflow for the repo. However in some cases not all workflow are meaningful and never be cared to visualize (e.g. scanning, specific testing, spiking ,etc.). If we could exclude these unimportant workflows, we could speed up the data sync as well as reduce some potential issue may have due to them.

Describe the solution you'd like Enable workflow configuration in the pipeline config.

Task 1: Specify workflows when create Github Actions pipeline

• (FE) Enhance the pipeline config UI with a section below Personal Access Token
• (FE) Once user clicks Verify button and verify successfully, a workflow API is also triggered to visualize the list of existing workflows
• (FE) User is able to select the workflows that they are interested in
• (BE) createPipeline(POST /project/{projectId}/pipeline) API accepts the additional configuration about workflow selections and store into DB

Task 2: Update workflows when configure Github Actions pipeline

• (FE) Display workflow config once Pipeline config popup is triggered, and initially fetch the latest workflow list
• (FE) User is able to update the workflow select and make an update
• (FE) Once URL/Personal Access Token is updated, the "Verify" triggering will update the workflow list accordingly
• (BE) getPipeline (GET /project/{projectId}/pipeline/{pipelineId}) API returns the additional configuration about workflow selections from DB
• (BE) updatePipeline (PUT /project/{projectId}/pipeline/{pipelineId}) API accepts the additional configuration about workflow selections and store into DB

Task 3: Sync data with only configured workflows

• (BE) Replace querying all runs to query only the configured workflows' run by the workflow run API
• (BE) For compatibility, if workflows are not configured yet when the sync is triggered, keep to query all runs

Additional context The config of workflow need to store both workflow name and workflow id.

UI position for the new config:

Hi Team,

I have installed the Metrick and tried to connect with the Jenkins pipeline. When I have specified the URL of the pipeline it does not take. It is showing the error: "jenkins.abc.com executing GET https://jenkins.abc.com/jenkins/job/OMS_Metrick/wfapi/."

As I have to debug this error. It is due that the GET method that Metrick is not taking it. {"status":500,"message":"Request method 'GET' not supported"}

Please look into this issue. As i am trying for DevOps metrics. @hyrepo Yang