This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
Solution Guide - Storage Made Easy !1
INTRODUCTION
This document outlines the solution architecture, configuration, functionality and performance characteristics of Storage Made Easy™ (SME) direct apps with IBM Cloud Object Storage (COS). The direct or “standalone” desktop applications, S3 Drive and S3 Explorer, work as independent desktop clients directly connecting IBM Cloud Object Storage. Configuration information was verified and performance information collected during a certification process at the IBM Cloud Object Storage Alliance Integration Team certification lab.
A separate guide provides information on the full stack Storage Made Easy Enterprise File Fabric™ product.
PRODUCTS TESTED
Storage Made Easy software: • Storage Made Easy S3 Drive 3.5.0 • Storage Made Easy S3 Explorer 3.5.0
IBM software: • IBM Cloud Object Storage – On Premise (version 3.10.2.72) • IBM Cloud Object Storage – US South (version 3.11.0.89) • IBM Cloud Object Storage – US Region (version 3.11.0.89)
S3 DRIVES
The S3 Drive enables users to mount and interact with IBM Cloud Object Storage as a local disk. Users can browse and open remote files with desktop applications including the Microsoft Office Suite. The Windows File Explorer can be used to copy, move and rename objects as if they were files and folders. The S3 Drive can also be accessed through Windows batch scripts as if it was a regular local drive.
S3 EXPLORERS
The S3 Explorer desktop application allows users to interact with IBM Cloud Object Storage through a familiar file explorer like interface. From the menu, or using drag and drop, users can easily upload, download and delete files and folders. Copying, moving and renaming objects and folders is also supported. Objects can be quickly located through search, and sensitive data automatically encrypted on upload.
SOLUTION GUIDE
STORAGE MADE EASY: S3 DRIVE & S3 EXPLORER IBM COS
ABOUT
STORAGE MADE EASY™ FILE FABRIC™
The Storage Made Easy File Fabric enables IT to regain control of "cloud data sprawl" by unifying on-premises
and cloud storage into a single, easily managed, converged
infrastructure with policy-based controls for governance, audit and
security.
Organizations use the File Fabric to enable workgroup collaboration, file
sharing and synchronization through a full suite of desktop, mobile and
web applications. The solution supports software-defined storage
(SDS) particularly well, enabling end users and legacy applications to
interact with object storage through the File Fabric as if it was a regular file system. Businesses are able to monitor, secure and audit company and employee data silos be they be
on premise, on the cloud, in file systems, in object storage or in
The certification exercise included installing products and executing functional and performance tests with IBM Cloud Object Storage - on premise and public cloud.
Functional tests centered around uploading, downloading, copying and deleting files and folders. App specific features such as rename and searching were also tested.
Performance testing focused on throughput supported by a single app simulating heavy usage by a single end user. Results were compared between on premise and cloud instances of IBM Cloud Object Storage.
SOLUTION ARCHITECTURE
The S3 Drive and S3 Explorer were deployed to a Windows 10 virtual machine. Other than endpoints, configuration for the different IBM COS instances was the same.
IBM COS Public Cloud For testing with IBM COS in the public cloud over the Internet the apps were configured for an S3 compatible endpoint over HTTPS.
IBM COS On-Premises An on premise deployment of IBM COS offers multiple endpoints for high availability. To allow the apps to use both endpoints a load balancer was used. An Nginx load balancer was used during certification but any open source or commercial load balancer (supporting HTTPS) would be appropriate.
Client The S3 Drive application was installed on two client machines: • O/S: Microsoft Windows 10 Pro Standard Install • RAM: 16GB • CPU: 8 • HDD: 500GB (SSD)
Other software installed: • Microsoft Office 2016 - used for functional testing • Fiddler 4 - used for identifying HTTP calls to IBM COS and for timing tests • Python - used for scripting operating system calls
• Boto 3 - used for scripting S3 calls in Python
Load Balancer An NGINX load balancer was used for IM COS On-Premise.
STORAGE MADE EASY S3 DRIVE
The S3 Drive enables users to mount and interact with IBM Cloud Object Storage as a local disk. For configuration information see Appendix A.
FUNCTIONAL TESTING
The objective of S3 Drive functional testing was to: • Verify compatibility with IBM Cloud Object Storage for both on premise and public cloud storage.
• Map S3 Drive user interactions to one or more IBM COS HTTP operations for capacity planning and budgeting.
• Validate and document any recommendations for optimum performance.
The S3 Drive tests were performed manually through the Windows 10 File Explorer and with Microsoft Office applications. The S3 Drive Cache was cleared before each test (Settings > Browse > Delete all).
Testing was successful against IBM COS - both on premise and public cloud storage.
The objective of S3 Drive performance testing was to: • Calculate throughput to assist with recommendations of appropriate use cases • Validate and document any recommendations for optimum performance.
A single workload was creating consisting of 161 in 17 folders, ranging in size from 1MiB to 1GiB. Total workload size was 10.4 GiB (11,161,589,120 bytes). The S3 Drive Cache was cleared before each test (Settings > Browse > Delete all).
Transfer and *Effective Transfer rates for S3 Drive
Rename and Delete operations were executed without data transfer between the S3 Explorer and IBM COS.
Observations: • Uploads are multi-threaded. Other operations are single-threaded.
The S3 Explorer desktop application allows users to interact with IBM Cloud Object Storage through a familiar file explorer like interface.
For configuration information see Appendix B.
FUNCTIONAL TESTING
The objective of S3 Explorer functional testing was to: • Verify compatibility with IBM Cloud Object Storage for both on premise and public cloud storage.
• Map S3 Explorer user interactions to one or more IBM COS HTTP operations for capacity planning and budgeting.
• Validate and document any recommendations for optimum performance.
Testing was successful against IBM COS - both on premise and public cloud storage.
Features
Create Root Folder - creates bucket Copy file
Delete Root Folder – removes bucket Copy folder
View Root items (buckets) Move file
Create Subfolder Move folder
Remove Subfolder - file hierarchy Rename File
Upload File Rename Folder
Download File Bucket Search
Browse Folder Sort files (name, modified, size)
Upload Folder Properties (root folder or file only)
GET (contents of bucket to possibly delete)DELETE (bucket)GET / (refresh explorer listing)
View Root items (buckets) GETCreate Subfolder PUTRemove Subfolder - file hierarchy GET /<bucket>Upload File PUT
GET (refresh parent folder)Download File GETBrowse Folder GET (contents cached for period of time)Upload Folder GET (refresh parent)Download Folder - file hierarchy GETCopy file PUT (x-amz-copy-source)Copy folder PUT (x-amz-copy-source)Move file GET folder
For each file:PUT (x-amz-copy-source)DELETE
Move folder GET folderFor each file:
PUT (x-amz-copy-source)DELETEDELETE folder
Rename File PUT (x-amz-copy-source)DELETE
Rename Folder GET folderFor each file:
PUT (x-amz-copy-source) DELETE
Bucket Search GET (for each 1,000 objects)Sort files (name, modified, size) None (client-side only)Properties (root folder or file only) HEAD