All Systems Operational

Updated 3 minutes ago

Workfront Status




Operational

ProofHQ Status




Operational

Data centers




Operational

Locations

External Services

AWS EC2

AWS S3

Rackspace

ProofHQ Uptime

100.00%




Workfront Uptime

100.00%




Avg. Response Time

103.23ms




Avg. Round Trip

197.88ms




Total Requests

1243766.65 Hits




ProofHQ Uptime

100.00%




Workfront Uptime

100.00%




Avg. Response Time

120.80ms




Avg. Round Trip

217.17ms




Total Requests

947442.45 Hits




ProofHQ Uptime

100.00%




Workfront Uptime

100.00%




Avg. Response Time

111.79ms




Avg. Round Trip

205.31ms




Total Requests

900527.90 Hits




Maintenance Windows North America: CL01 | CL02 | CL03 | ProofHQ 2nd and 4th Saturday 8:00 pm to 12:00 am MT 1st and 3rd Thursday 8:00 pm to 12:00 am MT EMEA: CL04 1st and 3rd Thursday 2:00 am to 4:00 am GMT CL01, CL02, CL03 Preview environments refresh on Saturday CL04 Preview environment refreshes on Friday **We infrequently schedule maintenance in the windows listed above. If down time is necessary, it will be scheduled in the corresponding window and announced on this page.**

History (Last 21 days)

Incident Status

Component Disruption - SEV 3


Components

ProofHQ Status


Locations

PHQ API, PHQ Web Application




March 6, 2017 1:25PM MST
[Investigating] Some users may be experiencing intermittent issues with logging in. Some API calls are returning "Invalid Session ID" errors. Our technical teams are investigating.

March 6, 2017 2:06PM MST
[Identified] We've identified the issues as connected to sessions management. We are working on fix for this

March 6, 2017 3:00PM MST
[Resolved] The issue with invalid user sessions has been resolved.

March 16, 2017 10:17PM MDT
[Resolved] Root Cause Analysis: A database replication error resulted in performance degradation and ultimately an outage. Remediation: We updated our replication configuration to eliminate the problem that caused the outage.
Slow Performance on Cluster 1Degraded Performance - SEV 2

Incident Status

Degraded Performance - SEV 2


Components

Workfront Status


Locations

CL01




March 9, 2017 7:10AM MST
[Investigating] The Workfront service is experiencing a performance issue. Users may see slow page loads and timeout errors when using the service. We are working to resolve the situation as quickly as possible.

March 9, 2017 9:16AM MST
[Monitoring] We are seeing intermittent performance issues and will keep the Incident open while we monitor the situation.

March 9, 2017 9:32AM MST
[Resolved] Performance has again returned to normal levels. We continue to investigate the issue and will provide more information on the root cause as it becomes available. We apologize for the service interruption and thank you for your patience.

March 16, 2017 10:12PM MDT
[Resolved] Root Cause Analysis: Internal application messaging was getting stuck within the system in a particular scenario. This resulted in extended consumption of system resources, which negatively impacted performance. Remediation: Made several updates to areas where messages were getting stuck and validated increased performance and stability with respect to messaging as a result of these changes.
Slow Performance on Cluster 1Degraded Performance - SEV 2

Incident Status

Degraded Performance - SEV 2


Components

Workfront Status


Locations

CL01




March 16, 2017 8:05AM MDT
[Investigating] The Workfront service is experiencing a performance issue. Users may see slow page loads and timeout errors when using the service. We are working to resolve the situation as quickly as possible.

March 16, 2017 8:55AM MDT
[Resolved] The Workfront service is experiencing a performance issue. Users may see slow page loads and timeout errors when using the service. We are working to resolve the situation as quickly as possible.
ProofHQ - proof processing issuesComponent Disruption - SEV 3

Incident Status

Component Disruption - SEV 3


Components

ProofHQ Status


Locations

PHQ Proof Processing




March 7, 2017 1:41PM MST
[Investigating] We are currently experiencing some issues with web capture proofs and combined proofs. The processing times for these items may be delayed. We are investigating.

March 7, 2017 2:40PM MST
[Resolved] The issues with proofs processing are now resolved. If any of your items did not generate ok go ahead and re-upload or reach out to the Support team for assistance.
Slow Performance on Cluster 1Degraded Performance - SEV 2

Incident Status

Degraded Performance - SEV 2


Components

Workfront Status


Locations

CL01




March 6, 2017 9:00AM MST
[Investigating] The Workfront service is experiencing a performance issue. Users may see slow page loads and timeout errors when using the service. We are working to resolve the situation as quickly as possible.

March 6, 2017 9:29AM MST
[Investigating] The Severity has been upgraded to a SEV 1. Workfront continues to work on the issue with the highest priority.

March 6, 2017 9:50AM MST
[Investigating] While still slow, performance has improved to the point that this Incident has been downgraded to a Severity 2. Workfront continues to work to resolve the issue as quickly as possible.

March 6, 2017 10:45AM MST
[Resolved] Performance has returned to normal levels. More information will be provided when Workfront has completed the analysis.