At a time when tape seems to be losing in popularity to its faster alternative disk -- open-systems director Simon...
Wiltshire of Fair Isaac Corp. discovers that using both a disk and tape storage area network (SAN) together helps cure backup headaches and eliminates backup windows.
As the preeminent provider of creative analytics, Fair Isaac uses predictive modeling, decision analysis, intelligence management, decision management systems and consulting services to help companies identify credit risks and fraud. It powers 25 billion mission-critical decisions each year for approximately 2,000 clients, including seven of the world's 10 largest banks, the top 50 U.S. credit card issuers and 90% of the top U.S. small business lenders. This makes for an ever-increasing amount of data growth.
"Our data growth rate is pretty extensive, we're generally adding about a terabyte or two a month. But we have lots of applications and lots of clients, so it's not like we have one application that generates two terabytes of data a month," Wiltshire said, explaining that many individual client projects and applications generate the majority of storage consumption.
He further breaks down the company's data growth to two primary drivers: One is that big data applications for its marketing services business were moved off the mainframe onto open systems, which has been a three-year process. This type of data includes customer lists, prospect lists and subscriber lists, which are merged and purged using multiple applications to develop clean lists and databases for marketing campaigns. The other is increased business, which led to opportunities to consolidate data and applications from other parts of the company to the main data center in St. Paul, Minn.
"We were putting more and more stuff on open systems and we were somewhat tactically adding DLT tape drives," Wiltshire said, noting that his team was spending a lot of time fixing backup failures in this environment. "We recognized that continually adding new libraries wasn't going to be enough at the rate that we were growing and migrating."
"We had to make a decision to make the big leap," Wiltshire said, explaining how his team made the decision to go down the path of a fully-fledged open systems environment.
In Nov. 2000, the company invested in an EMC Clariion disk SAN, which is connected to its big data servers. The next objective was to find a fabric-attached backup solution that was capable of handling current data and predicted growth.
After several consulting engagements, by the end of 2001, Wiltshire's team decided they needed to go down a tape SAN path. They chose the StorageTek solution 9940A fibre drives, which allows them to also have fabric-attached tape drives. The only problem was that his team didn't have the skills to work with the technology.
Turning to CNT for project management and technical help, Wiltshire's team was able to design a tape SAN with separate switches and fabric from the disk SAN so the largest servers -- which come together in the host server and the network -- are not involved in the backup process. The system was constructed according to three levels of backups.
In the first level, the biggest 10 or 12 enterprise servers are directly fabric-attached through an additional host bus adaptor (HBA) with a fibre route into the switch fabric that supports the tape drives. The second level is comprised of servers with reasonable amounts of data, but not enough to warrant the financial costs of HBAs and ports to put them directly on the tape fabric. These are backed up over a Gigabit Ethernet network to a pair of Veritas media servers, which are fabric connected. The third level is made up of all remaining servers that are backed up over 10/100 Ethernet, rather than the Gigabit Ethernet connection, according to Wiltshire.
The bulk of data being backed up in this environment is related to Fair Isaac's marketing services business, as well as production applications in the company, Wiltshire said, including data from the MyFico Web site (its online source for credit scoring), Exchange servers, file servers and even desktops.
The original configuration, which consisted of 20 DLT 8000 drives across four tape libraries, required "very heavy maintenance," Wiltshire said. Since the tape SAN implementation, he's seen a dramatic improvement in backup reliability, with an increase in first-time completion rate from 60% to 98%, and significant decrease in the amount of time spent by employees to run backups. "Now they can actually do what they get paid for," he said.
His team can also run full and incremental backups every night, staggered for a relatively even schedule, without concern for downtime. "We back up the same amount of data on Sunday as we do on Wednesday," Wiltshire said. "Backup windows are a thing of the past."
An unexpected benefit is the availability of StorageTek 9940B drives, "which have double capacity and double the speed" of 9940A drives, Wiltshire said.
"We made a decision a year and a half ago that we thought was strategic, and it's proven to be so," Wiltshire added.
For more information on Fair Isaac Corp., visit its Web site.
Information on CNT can be found here.
Or read about StorageTek here.