NYC Outage Puts Cloud and BCP in the Spotlight: 8 Tips
The city that never sleeps was plunged into darkness when a faulty cable on the Upper West Side knocked out power to nearly 70,000 residents. The outage impacted power networks across 42 blocks of Manhattan, including Midtown – the home to numerous hedge funds and investment management firms.
Luckily the outage occurred on a Saturday evening when most firms were closed, but for non-cloud organizations there was still IT recovery work to be done. Here at Eze Castle Integration our support teams jumped into action to help 20+ clients reboot and bring up their on-premise IT environments.
On the flip side, our Eze Cloud clients had no worries given the redundancy of our cloud solution. This situation was a clear reminder that disaster incidents can occur anywhere so firms must be prepared. It also highlights another value-add of our Eze Managed Cloud solutions.
Beyond plugging the value of cloud, I’ll leave you with some handy business continuity tips in case you find yourself in a similar situation:
1. Determine how/where your employees will work in the event of an incident.
Some firms opt to identify a secondary work site, but in the event of a widespread or regional event, you may find that location is inaccessible also. You should also consider if transportation is/will be impacted by the incident. If road conditions are bad or public transportation is shut down, employees will have to remain home.
If your firm supports remote access capabilities, ensure employees are prepared with the necessary infrastructure, workload expectations and communication tools.
2. Ensure employees test for remote access before an incident occurs.
If your firm plans to allow employees to work remotely, it is critical that employees understand HOW to work remotely. Provide users with login information and ensure they have the appropriate resources at home to support their needs:
Required software or applications
Testing is imperative here. If an incident strikes and an employee realizes he/she cannot login remotely, you could end up having to shift responsibilities at the last minute or, worse, projects may fall through the cracks.
3. Provide employees with quick reference cards and/or wallet cards with high-level BCP information.
A great way to ensure employees have access to all the information they could need during a winter event is to provide quick reference or wallet cards. These handy documents should contain the following:
Key personnel contact information
Alternate site location/directions
Remote access instructions
Call forwarding instructions
4. Keep in communication with your employees before, during and after a winter event.
A once-off email is not enough during a weather-related event. During any type of disaster, it’s imperative to keep employees (as well as investors, clients and other third parties) informed at all times.
Try to provide as much information as possible during your updates. Employees should be confident the firm is in full control and business operations will be unaffected by the incident. Provide employee workload expectations, recovery steps the firm is undertaking and how long you expect the situation to last.
Post-incident, share what you learned from the experience: the positives and negatives. Employees will appreciate that you are forthcoming and are willing to work to improve procedures.
5. Consider an emergency notification system to alert employees and/or third parties.
Traditional calling trees are cumbersome and time consuming, and emails—especially outside of business hours — can often be overlooked. Automated emergency notification systems (ENS) can quickly and effectively deliver messages to various parties using a variety of methods.
When shopping for a ENS system, here are a few features to look for that could serve you well during a business continuity scenario:
SMS texting: Unlike calls, texts can be queued if there are service interruptions during a disaster
Two-way messaging: Allows users to respond to basic questions if needed
Mobile/remote access: Allows the system to be activated remotely or from a mobile device—convenient during a storm
Scheduled messaging: Having a “canned” message or scheduling notifications in advance can save time
6. Store investor and third party vendor information on a mobile device or accessible shared drive in the event your office/PC are unavailable.
Remote access is critical during a winter storm or other disaster scenario. If your role requires you to be in constant contact with clients, investors or other counterparties, you’ll want to consider how to communicate with them if you can’t access your primary work environment. Storing contacts on a mobile device is one way to ensure you always have contact information readily available—as long as your device is charged!
7. Establish contingency plans for critical roles and responsibilities in the event some employees are unable to work remotely or maintain their workload.
Realistically, some employees have more mission-critical roles than others. Portfolio managers and investor-facing employees, for example, are likely considered more “essential” than administrative assistants and marketing execs. In the event essential personnel are impacted by a winter event and unable to perform their duties, you may want to consider a contingency plan that includes other employees who may be able to pick up the slack.
8. Conduct BCP scenario planning and tabletop exercises to ensure employees are clear on disaster procedures.
The key to successfully weathering a winter storm is ensuring the entire organization understands what’s expected of them. And the only way to properly achieve that is through testing.
Tabletop exercises are a great way to get your response team working in step. These informal brainstorming sessions encourage participation from management and other key employees. The group typically discusses a variety of potential scenarios and covers all of the actions necessary to ensure employees are safe and accounted for and the business can continue to operate. Firms could also conduct full-scale BCP tests to give all employees the opportunity to participate and share feedback with the group.