Partially Degraded Service
Uptime over the past 90 days. View historical uptime.
Advantage Operational
90 days ago
100.0 % uptime
Today
WesTech Marketing Cloud ? Operational
90 days ago
100.0 % uptime
Today
Blueshift Operational
90 days ago
100.0 % uptime
Today
IRIS Operational
90 days ago
99.73 % uptime
Today
Platform Integration Engine (PIE) ? Operational
90 days ago
100.0 % uptime
Today
PIE Job API ? Operational
90 days ago
100.0 % uptime
Today
ADV Rest Adapter ? Operational
90 days ago
100.0 % uptime
Today
Hasura REST API ? Operational
90 days ago
100.0 % uptime
Today
Signup App Operational
90 days ago
100.0 % uptime
Today
Data & Analytics Operational
90 days ago
100.0 % uptime
Today
Portfolio Tracker Operational
Deliverability Operational
90 days ago
100.0 % uptime
Today
IT Operational
90 days ago
100.0 % uptime
Today
IT | General Operations Operational
90 days ago
100.0 % uptime
Today
OpenShift Cluster | APJ1 ? Operational
90 days ago
100.0 % uptime
Today
OpenShift Cluster | C3-BALT ? Operational
90 days ago
100.0 % uptime
Today
OpenShift Cluster | C4-AWS-DEV ? Operational
90 days ago
100.0 % uptime
Today
OpenShift Cluster | C6-OSD ? Operational
90 days ago
100.0 % uptime
Today
OpenShift Cluster | C7-OSD ? Operational
90 days ago
100.0 % uptime
Today
OpenShift Cluster | C3 "AWS3-PRD" ? Operational
90 days ago
100.0 % uptime
Today
OpenShift Cluster | BALT2-PRD ? Operational
90 days ago
100.0 % uptime
Today
OneLogin Operational
90 days ago
100.0 % uptime
Today
Atlassian Products Operational
90 days ago
100.0 % uptime
Today
OneTrust ? Operational
90 days ago
100.0 % uptime
Today
FinTech Degraded Performance
90 days ago
100.0 % uptime
Today
PayGate Operational
90 days ago
100.0 % uptime
Today
OneSource Operational
90 days ago
100.0 % uptime
Today
Spreedly Degraded Performance
90 days ago
100.0 % uptime
Today
Operational
Degraded Performance
Partial Outage
Major Outage
Maintenance
Major outage
Partial outage
No downtime recorded on this day.
No data exists for this day.
had a major outage.
had a partial outage.

No incidents or maintenance related to this downtime.

Past Incidents
Apr 29, 2024

No incidents reported today.

Apr 28, 2024

No incidents reported.

Apr 27, 2024

No incidents reported.

Apr 26, 2024

No incidents reported.

Apr 25, 2024

No incidents reported.

Apr 24, 2024

No incidents reported.

Apr 23, 2024

No incidents reported.

Apr 22, 2024
OneLogin Degraded Performance
Resolved - This incident has been resolved.
Apr 22, 15:40 EDT
Monitoring - OneLogin reports the issue has been resolved. We'll will continue to monitor OneLogin performance to confirm.
Apr 22, 11:17 EDT
Investigating - Is the ability to take or process orders affected?
No

Are Customers able to access their products?
Yes

The Issue
Sporadic reports of OneLogin time outs and slowness when attempting to login.

The Impact
Our team is presently investigating the true impact and severity of this incident. We are treating this as a priority.

Next Update
We will update you as soon as we have got a clearer understanding of the full impact but rest assured that we are treating this as a priority and will communicate ASAP.

For updates in real-time, you can check here at https://14west.statuspage.io/.

Thank you,

14West Technologies Support
Apr 22, 09:32 EDT
Apr 21, 2024

No incidents reported.

Apr 20, 2024

No incidents reported.

Apr 19, 2024

No incidents reported.

Apr 18, 2024

No incidents reported.

Apr 17, 2024
WMC database issue
Resolved - Updates
The database issue has been resolved by the IT team and the upsell issues have been resolved by the WMC team by manually re-syncing the choices in our database.

Root Cause
The root cause of these issues was due to a WMC database reaching full disk space, preventing the WMC application from processing orders. This issue occured between 9:53AM (EST) - 10:52AM (EST)

Next Steps
There is existing alerting set up to alert on diskspace issues with this database, however it did not trigger. The IT team is looking into the "why" and will be updating the alerting to prevent this issue from happening again in the future. We are also working to double our available diskspace to assist with any increases of data due to regular deployments from the WMC team.

We are digging through the WMC logs to gather the list of customers that attempted to place an order but were unable to due to these issues. We will be contacting each affiliate individually with those lists today.

Please reach out to Sarah Smiley if you have any issues or concerns.

Thank you,

14West Technologies Support
Apr 17, 12:09 EDT
Update - We are continuing to monitor for any further issues.
Apr 17, 11:30 EDT
Monitoring - Is the ability to take or process orders affected?
Yes

Are Customers able to access their products?
Yes

The Issue
WMC team was alerted at 10:36 AM EST that there was an issue with our database diskspace causing errors with order processing.

* Possibly related to the database issue, Oxford and Banyan have both reported issues with loading upsell pages and placing upsell orders. The WMC team is digging into the upsell reports.

The Impact
Our team is presently investigating the true impact and severity of this incident. We are treating this as a HIGH priority. The IT team has already worked with AWS to increase diskspace and the errors related to diskspace have been resolved. WMC appears to be operating as normal however we are gathering information on impacted orders and how alerting can be improved to prevent this issue in the future.

Next Update
We will update you as soon as we have got a clearer understanding of the full impact but rest assured that we are treating this as a priority and will communicate ASAP.

For updates in real-time, you can check here at https://14west.statuspage.io/.

Thank you,

14West Technologies Support
Apr 17, 11:26 EDT
ADVISORY - WMC degraded performance 5:51 AM EST
Resolved - Is the ability to take or process orders affected?
Yes

Are Customers able to access their products?
Yes

The Issue
We wanted to make you aware of an incident that happened early this morning with WMC. The team was doing a routine deployment and encountered some unexpected issues with the SQL migration that caused degraded WMC performance for 11 minutes and 30 seconds. The deployment was rolled back and the issues were fixed.

at 5:51 AM EST a database update has started
at 5:51:30 AM EST we started seeing some errors
at 6:03 AM EST- the problem is resolved, all back to normal

The Impact
Some customers may have seen pages loading slow.
9 customer pages failed to load. - We do not have data on these customers as that is captured during page load.
3 orders had been placed during this time successfully, but WMC did not render a confirmation page to these customers. - Confirmation emails were still triggered via Blueshift and sent out.

Please reach out to Sarah Smiley with any questions or concerns.

Thank you,

14West Technologies Support
Apr 17, 09:34 EDT
Apr 16, 2024
Scheduled ThoughtSpot Maintenance 10pm EDT Monday, April 15th
Completed - The scheduled maintenance has been completed.
Apr 16, 02:00 EDT
In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.
Apr 15, 22:00 EDT
Scheduled - ThoughtSpot service will not be available due to scheduled maintenance on Monday, April 15th beginning at 10pm EDT. This lapse in service is expected to last until 2am EDT on Tuesday, April 16th. Please reach out with any questions or concerns.

Thank you,
Data & Analytics
Apr 12, 13:10 EDT
Apr 15, 2024
← Incident History Powered by Atlassian Statuspage