Overview of Core and Edge as a System
  
Overview of Core and Edge as a System
This chapter describes the Core and Edge components as a virtual storage system. It includes the following sections:
•  Introducing branch converged infrastructure
•  How the SteelFusion product family works
•  System components and their roles
•  Blockstore prefetch and prepopulation
•  Related information
Introducing branch converged infrastructure
SteelFusion is a converged infrastructure solution, encompassing all branch services such as server, storage, networking, and WAN optimization. It is a dual-ended system that comprises two logical components: SteelFusion Edge and SteelFusion Core.
SteelFusion Core is a physical or virtual appliance in the data center that mounts all LUNs that need to be made available to applications and servers at a remote location from the back-end storage array. SteelFusion Edge provides a virtualized environment that hosts the branch application servers. Core appliances communicate across the WAN with the Edge appliances at the branch.
SteelFusion delivers local user performance while enabling data centralization, instant recovery, and lower total operating costs. Unlike traditional converged infrastructures, SteelFusion enables stateless branch services. You can access applications that run locally in your branch while the primary data is centralized in your data center. Decoupling computation from its underlying storage allows your applications to run in a stateless mode, which reduces your branch footprint and centralizes management of your branch services.
With the SteelFusion product family, data center administrators can extend a data center storage array to a remote location, even over a low-bandwidth link. SteelFusion delivers business agility, enabling you to effectively deliver global storage infrastructure anywhere you need it.
SteelFusion provides the following functionality:
•  Innovative block storage optimization ensures that you can centrally manage data storage while keeping that data available to business operations in the branch, even in the event of a WAN outage.
•  A local authoritative cache ensures LAN-speed reads and fast cold writes at the branch.
•  Integration with Microsoft Volume Shadow Copy Service enables consistent point-in-time data snapshots and seamless integration with backup applications.
•  Integration with the snapshot capabilities of the storage array enables you to configure application-consistent snapshots through the Core Management Console.
•  Integration with industry-standard Challenge-Handshake Authentication Protocol (CHAP) authenticates users and hosts.
•  A secure vault protects sensitive information using AES 256-bit encryption.
•  Solid-state disks (SSDs) that guarantee data durability and performance.
•  An active-active high-availability (HA) deployment option for SteelFusion ensures the availability of storage array logical unit numbers (LUNs) for remote sites.
•  Customizable reports provide visibility to key utilization, performance, and diagnostic information.
By consolidating all storage at the data center and creating diskless branches, SteelFusion eliminates data sprawl, costly data replication, and the risk of data loss at the branch office.
How the SteelFusion product family works
The SteelFusion product family is designed to simplify infrastructure in remote offices and branch offices and manage it centrally from a data center. The SteelFusion product family is typically deployed in conjunction with SteelHeads and includes the following components:
•  Core - Core is a physical or virtual appliance deployed in the data center alongside SteelHeads and the centralized storage array. Core mounts iSCSI LUNs provisioned for the branch offices. Additionally, Core-v can mount LUNs through Fibre Channel.
•  Edge - Edge refers to the branch component of the SteelFusion solution. The Edge hosts two distinct functions, or nodes:
–  WAN optimization
–  Hypervisor platform with VMware vSphere
The Edge presents itself to application servers in the branch as an iSCSI storage portal. From the portal, the application server uses iSCSI to mount the iSCSI LUNs that are projected across the WAN from the data center. Edge can also host local LUNs for use as temporary storage that are not projected from the data center: for example, temporary or local copies of software repositories.
For a list of qualified software and storage systems, we strongly recommend that you read the SteelFusion Interoperability Matrix at https://splash.riverbed.com/docs/DOC-4204.
For information on compatibility between SteelHead software (RiOS), Edge, Core, and vSphere releases, see the Riverbed Knowledge Base article RiOS, SteelFusion Edge, SteelFusion Core and vSphere Release Matrix at https://supportkb.riverbed.com/support/index?page=content&id=S27472.
The branch office server connects to the Edge, which implements handlers for the iSCSI protocol. The Edge also connects to the blockstore, a persistent local cache of storage blocks.
SteelFusion initially populates the blockstore using the following methods:
•  First request - Blocks are added to the blockstore when first requested. Because the first request is cold, it is subject to standard WAN latency. Subsequent traffic is optimized.
•  On-demand prefetch - The system observes block requests, applies heuristics based on these observations to intelligently predict the blocks most likely to be requested in the near future, and then requests those blocks from the data center LUN in advance.
•  Policy-based prefetch - Configured policies identify the blocks that are likely to be requested at a given branch office site in advance; the Edge then requests those blocks from the data center LUN in advance.
For details on blockstore population, see Blockstore prefetch and prepopulation.
System components and their roles
Figure: Generic SteelFusion deployment shows the various components in a basic SteelFusion deployment.
Figure: Generic SteelFusion deployment
•  Branch server - One or more branch-side servers that access data from the SteelFusion system instead of a local storage device. These servers can also run as virtual machines (VMs) within the Edge hypervisor node.
•  Blockstore - A persistent local cache of storage blocks. Because each Edge is linked to one or more dedicated LUNs at the data center, the blockstore is authoritative for both reads and writes. In Figure: Generic SteelFusion deployment, the blockstore on the branch side synchronizes with its LUN(s) at the data center.
•  iSCSI initiator - The branch-side server that sends SCSI commands to its iSCSI target that is the Edge in the branch. At the data center, the Core is an iSCSI initiator that sends SCSI commands to access LUNs through an iSCSI target in the storage array.
Note: Although not shown in Figure: Generic SteelFusion deployment, Core can also use Fibre Channel to the storage array.
•  Edge - The branch-side component of the SteelFusion system that links the blockstore through the Core to the LUN at the data center. The SteelHead provides WAN optimization services.
•  Data center SteelHead - The data center-side SteelHead peer for WAN optimization.
•  Core - The data center component of the SteelFusion product family. The Core manages block transfers between the LUN and the Edge.
•  iSCSI target - Depending on what side you are on:
–  In the branch office, it’s the Edge that communicates with the branch-side iSCSI initiator in the branch server.
–  In the data center, it’s the storage array that communicates with the Core iSCSI initiator.
•  LUN - A unit of block storage deployed from the storage array and projected through the Core to the Edge. More than one LUN can be projected to an Edge.
At the data center, Core integrates with existing storage systems, virtual infrastructure, and SteelHead deployments. Core connects dedicated LUNs with each Edge appliance at the branch office.
The branch office server connects to Edge, which implements handlers for the iSCSI protocol. The Edge also connects to the blockstore, a persistent local cache of storage blocks within the Edge itself.
The blockstore is the Edge authoritative persistent cache of storage blocks. The blockstore is local from a branch perspective and holds blocks from all the LUNs available through a specific Edge. The blockstore is authoritative because it includes the latest-written blocks before they are sent through the Core to a storage array at the data center. When a server at the branch office requests data blocks, those blocks are served locally from the blockstore if those blocks are currently present. If they are not present, the Edge retrieves them through the Core from the data center LUN. Similarly, newly written blocks are spooled to the local blockstore, acknowledged by the Edge to the branch office server, and then asynchronously propagated to the data center. Because each Edge implementation is linked to one or more dedicated LUNs at the data center, the blockstore is authoritative for both reads and writes and can tolerate WAN outages without affecting cache coherency.
Blocks are transferred between the Edge and the Core through an internal protocol. The Core then writes the updates to the data center LUNs through the iSCSI or Fibre Channel Protocol (FCP). SteelFusion is designed to be coupled with the SteelHead WAN optimization. You can further optimize traffic between the branch offices and the data center by implementing SteelHeads.
For more information about Fibre Channel, see SteelFusion and Fibre Channel.
The data cache in the blockstore is stored as is, and it is not deduplicated. Edge appliances include the SteelHead, and in the data center, the Cores are coupled with SteelHead products, which assist with data reduction and streamlining between the Edge and the Core.
You can encrypt the blockstore cache at rest using AES 128/192/256-bit encryption. This encryption eliminates the risk if your appliances are stolen. Similarly, because SteelFusion enables the removal of physical tape media and backup devices traditionally used for data protection from the remote offices, this encryption also eliminates risk of data theft. As a result, the blockstore eliminates the need for separate block storage facilities at the branch office and all the associated maintenance, tools, backup services, hardware, service resources, and so on.
For more information about blockstore encryption, see At-rest and in-flight data security.
Blockstore prefetch and prepopulation
One of the drawbacks of block storage protocols like iSCSI or Fibre Channel communicating across a wide area network (WAN) is that the subsequent requests for further data blocks may be non-sequential to the point that they seem random. This randomness is by design and a facet of the backend storage, but it makes rapid data delivery across a WAN using a block storage protocol difficult due to the high-latency adding a long turnaround time between request and response.
One way to mitigate this effect is for the sending side to be able to predict in some way what the subsequent requests will be so that data can be sent without waiting for the request. However, this is not possible with traditional storage protocols.
The SteelFusion architecture is appropriate for this type of approach because data on the Edge is held locally in the blockstore. Blockstore is the persistent local cache of storage blocks linked to one or more dedicated LUNs at the data center. As long as the data blocks that the Edge wants to read are already in blockstore, no request needs to be transmitted across the WAN through the Core to backend storage. Instead, the Edge responds to the read request serving data at local disk speed. Since the Edge blockstore benefits from a three-tier architecture of memory, solid-state disk (SSD), and hard disk drive (HDD), the read response is faster than could be achieved by storage in traditional branch servers. But if the required data is not in blockstore (called a blockstore miss), the Edge requests the data from the backend storage by asking the Core. The Core understands specific blockstore formats and can send the requested data and also continue to proactively send across additional blocks of data to the blockstore that it predicts the Edge may need. If the prediction is successful, the Edge will then find the subsequent data it needs locally in the blockstore and therefore does not need to submit further requests to the Core.
Depending on the scenario, populating the Edge blockstore can be performed by one or more of these methods:
•  Prefetch - The act of pushing data out from the Core in response to a blockstore miss at the Edge. Not only does the Core push out the requested blocks, it also sends across additional blocks that it predicts may be required by the Edge on subsequent reads. Note that prefetch is reactive (or, on-demand) in that it operates in response to the Edge. Intelligence within the Core means that prefetch works well with LUNs that are either VMFS or NTFS format.
•  Policy-based prefetch - Not a specific prefetch technique, but a term used to describe a selection of different “proactive” methods designed to populate the Edge blockstore. These methods are all types of prepopulation.
•  Prepopulation (sometimes referred to as full prepopulation) - Designed to be used for pinned LUNs. Prepopulation is the act of proactively sending data without a request from the Edge. This method is used for any type of pinned LUN and is very beneficial for LUNs that are not VMFS or NTFS format (for example, FAT32, ext3, ext4, and so on).
Note: Prepopulation does not work with unpinned LUNs. Unpinned LUNs are populated dynamically (incorporating prefetch) as the Edge begins using them.
•  Branch recovery (sometimes referred to as hot prepopulation and sometimes confused with smart prepopulation) - A type of prepopulation which enables the Core to proactively send across the working set of data blocks. This feature only applies to NTFS or VMFS LUNs and uses a service called the Branch Recovery Agent. For more information about this feature, see Branch recovery.
Smart prepopulation (sometimes referred to as intelligent prepopulation) - A type of prepopulation where the Core proactively sends all used blocks in a volume with no regards to the working set blocks. Smart prepopulation is only required if your pinned LUN is VMFS or NTFS.
For more information about how to enable or configure the different types of prepopulation, see the SteelFusion Command-Line Interface Reference Manual.
Related information
•  SteelFusion Core Management Console User’s Guide
•  SteelFusion Edge Management Console User’s Guide
•  Riverbed Splash at https://splash.riverbed.com/community/product-lines/steelfusion
•  SteelFusion Interoperability Matrix at https://splash.riverbed.com/docs/DOC-4204
•  Riverbed Knowledge Base article RiOS, SteelFusion Edge, SteelFusion Core and vSphere Release Matrix at https://supportkb.riverbed.com/support/index?page=content&id=S:S27472