Transforming Data Streams with Kafka Connect: An Introduction to Single Messa...
Storgrid Whitepaper
1. Whitepaper
Safe, User-Centric and Versatile
File Sharing and Collaboration
STORGRID R&D • SCIENCE PARK 5630 • 5692 EN SON • NL
STORGRID EMEA • JADELAAN 99 • 2132 XZ HOOFDDORP • NL
STORGRID NORTH AMERICA • 505 North Brand Boulevard • 16th Floor • Glendale, CA 91203 • USA
Introduction
Storgrid is an innovative file management platform that permits corporate users to effortlessly access and manage their
network files, as they simultaneously collaborate with colleagues, clients and partners, irrespective of geographical
location or choice of computing device. Using the most modern and secure connectivity protocols Storgrid provides the
ideal solution for corporate clients who demand flexibility without compromises to data security.
Conventional File Management Is Obsolete
Old-style file service consists of fileservers (NAS) mapped as ‘network drives’ in a local LAN environment. CIFS protocol
generally helps connect PCs to these internal ‘shares’. Access is often clumsy and is controlled centrally by IT. Within the
organizational firewall shares are easily accessible, but once a device has left the premise, share drives are no longer
available. Attempts to access CIFS shares from outside firewalls using VPNs and other techniques have met limited
success. Moreover CIFS is unsuited for mobile device access especially over low bandwidth connections. Remote team
members can’t easily create new shares for team projects, making information exchange cumbersome. Sharing large files
and folders with external partners becomes almost impossible. Only individual files can be attached in an email; attach-
ing complete folders is not feasible. Most IT organizations limit email attachments at an insufficient 20MB limit, definitely
inadequate for multimedia and other heavy files. Users find themselves in a vicious circle as they scramble for back-door
ways to transfer large files, often resorting to unsafe methods from a security standpoint, well outside the purview of IT.
Imperfect Work-Arounds and Security Risks
The most common work-arounds take one of two forms. Either a very complex workaround is provided for mobile working, in
the form of centralized workflow management systems, or users individually find their own solutions, bypassing internal IT with
‘unsupported’ and generally insecure ‘free’ public cloud solutions on the internet or other physical options such as USB sticks,
DVDs, external HDs etc. Although this method solves an individual’s issue at hand, the organization not only surrenders over-
sight and compliance but ‘data leakage’ becomes a potential risk, especially when confidential information is at stake.
2. STORGRID R&D • SCIENCE PARK 5630 • 5692 EN SON • NL
STORGRID EMEA • JADELAAN 99 • 2132 XZ HOOFDDORP • NL
STORGRID NORTH AMERICA • 505 North Brand Boulevard • 16th Floor • Glendale, CA 91203 • USA
The World is User-Centric
Ignoring the danger of data leakage and continuing to let users use external and unsupported data storage solutions remains
one option. Providing users with tools that render their data safe yet portable and always accessible on devices of their
choice is the superior alternative. Users will continue to demand and use solutions that let them work productively, easily and
remotely. The ‘Consumerization of ITʼ is already here, and IT must embrace technologies that abet users, not hinder them.
Storgrid: Embracing Simplicity
The best solutions are often the simplest. Users routinely reject complexity. They just want to easily access, use, modify,
and share their data. Anytime, with anyone, from anywhere. Storgrid is aware of these market demands and is the answer
to the BYOD (Bring Your Own Device) challenge. Storgrid grants corporate and public sector clients the same ease of
use of modern-day consumer-centric file storage and sharing solutions, but without risking data leakage. This single
solution perfectly incorporates an organization’s non-negotiable demand for data security while satisfying internal users
and IT departments.
Bring Home the “Home Directory”
Storgrid essentially makes a user’s traditional ‘home directory‘ available on the user’s primary computer, be it a Windows or
MAC platform. Now the user can work on the data locally, and always access it from any mobile device. Data is automatically
synchronized back to Storgrid’s central fileserver, or internally, depending on the functionality the corporate client selects.
Versatile Access - Web, Local or Mobile
Web Browser:
After obtaining network connectivity, accessing data via Storgrid from Windows PCs or MACs occurs via a secure web
interface, whereby the browser transforms into a ‘local folder’. Folders and files are clearly visible, users can ‘drag&drop’
files into the browser, directly linked to the Storgrid server, external or internal. Data imported into the browser immediate-
ly synchronizes the files to any or all other devices the user is operating.
Local Storgrid Client:
As previously mentioned, Storgrid also features “offline working”, a local client interface which not only synchronizes data
locally, but also guarantees 100% data access, for example on an aircraft, or from any location where internet connectivity
is poor or unavailable. The Storgrid local client automatically synchronizes data modifications with the centralized dataset
when the network is again available. The local client supports Windows and MAC operating systems.
Mobile Devices:
Mobile devices like iPhones, iPADs and Android machines are universal in the business world, and Storgrid allows full
browsing of synchronized data, including sharing and sending folders and files from mobile devices. Before sending files,
the mobile device relays a command to the server to make certain that data is not sent via the subscription plan of the
mobile device, thereby eliminating unnecessary expenses.
3. STORGRID R&D • SCIENCE PARK 5630 • 5692 EN SON • NL
STORGRID EMEA • JADELAAN 99 • 2132 XZ HOOFDDORP • NL
STORGRID NORTH AMERICA • 505 North Brand Boulevard • 16th Floor • Glendale, CA 91203 • USA
Sharing and Sending Folders and Large Files
Via Storgrid users can easily send folder structures and large files to external partners or customers. Any folder structure
(including subdirectories) and files, size notwithstanding, can be transferred by an emailed link which when clicked, opens
a browser on the recipient’s device from which one can view or download the data. The email link is the chosen option for
security reasons. The landing page of the link could be leverage for internal and external messaging, if appropriate. In the
absence of size limits the Storgrid solution effectively does away with archaic methods such as FTPs and zipped files.
Data Management and Protection – Powered by Storgrid and NetApp
By moving a user’s filing data to the local desktop, primary data, albeit at one’s fingertips, is nevertheless subject to hard
drive or device failure. Storgrid preempts this risk by automatically saving a copy on the cloud. The Cloud copy is the
ultimate central Data Store to protect and share. The Data synced to the “On-Premise” and/or Storgrid cloud is always
stored on an enterprise class storage platform (NetApp) optionally over multiple datacentres which adhere to the most up
to date corporate data protection standards.
File Versioning is supported by the Storgrid application
For any existing file, Storgrid offers a simple restore of multiple versions of a given file. This functionality is not time
based, so for example, 5 versions of a file created in the previous 5 minutes will be available for restore by the end user.
NetApp SnapShot Integration is a key benefit for users
Storgrid has created a ‘SnapShot button’ in the browser interface which gives the individual user a view of historical hour-
ly, daily and weekly SnapShots, and allows users to make simple selections of data for immediate restore to their remote
folder. Data is then immediately synchronized back to all local laptops and mobile devices. This means that even if the
user were to delete all data, it would be easily restorable due to integrated NetApp read-only SnapShots, which can never
be deleted or altered by end users. SnapShot schedules are created by the corporate IT administrators.
Disaster Recovery and Business Continuity
This is integrated automatically in the Storgrid Solution. All data is replicated offsite using NetApp SnapMirror to alternate
locations. Should a data centre fail, or connectivity rupture, all users will be automatically redirected to the alternate loca-
tion, where the Storgrid sensitive server infrastructure will continue to service synchronization and users requests.
Quick and Easy Implementation - Very Limited Data Migration
An organization can adopt this novel system of file-serving and collaboration either instantaneously or within a defined
time-frame, depending on the selected deployment model. The installation and implementation, using VMware is always
swift and straightforward.
Storgrid will mainly be implemented in an existing environment using Active Directory (AD) for single authentication and user
management. Most organizations already use NetApp technology for large-scale file-serving. Storgrid can integrate the existing
home-shares through AD without physically migrating the data so that users are assured full and uninterrupted data access.
Since migration doesn’t require dual storage capacity, an organization also reaps an advantage from a cost perspective.
Simplify Collaboration
Once data is in Storgrid on the local device, any folder or file can be shared in real-time when connected. Newly created or
modified data is synced to the central server, and then pushed out to participating team members automatically, with no addi-
tional action required from the main user. Users can share data easily using any device. Storgrid delivers data produced on any
operating system. Collaboration is limited to an authorized user base, typically defined as members of specific Active Directories.
4. STORGRID R&D • SCIENCE PARK 5630 • 5692 EN SON • NL
STORGRID EMEA • JADELAAN 99 • 2132 XZ HOOFDDORP • NL
STORGRID NORTH AMERICA • 505 North Brand Boulevard • 16th Floor • Glendale, CA 91203 • USA
Flexible Deployment Models
Storgrid realises that to gain acceptance within enterprise class IT organizations, deployment models must respect
official policies. The external server model sometimes provokes resistance. In response to such concerns Storgrid
has a ‘Hybrid’ deployment strategy, which converts Storgrid into a flexible tool that can adhere to any corporate
deployment model. Flexibility is specifically offered on three points:
Management – Storgrid can be managed by the customer or by Storgrid.
Ownership – Storgrid infrastructure can be owned by the customer or by Storgrid.
Location – Storgrid can be located at the customer site, or at Storgrid data centers.
Customer Silos
Storgrid deploys a separate Storgrid instance and VM(s) for each customer, therefore there is no cross- access
or single user database. Each Storgrid deployment is constructed as per the standard blueprint architecture and
customized to meet each customer’s specific requirements.
Level 1 Security
• Hosted by Storgrid, but customer retains legal data ownership
• IPSEC with SSL3 line encryption (256bit) for all data
transfers, upload/downloads.
• Username/Password for remote access.
• ISO Certified Data Center Locations.
• Professional Certified in-house administrators.
• Entire architecture including storage hosted by Storgrid
as a single provider.
• Dedicated VM, Storgrid Instance and isolated storage
volume per customer.
• Locked Data Center cages with high physical security
access levels.
• Real-time virus scanning on central data store.
• At-rest cloud side encryption (option requires dedicated
disk pool).
Level 2 Security (includes Level 1)
• Active Directory Integration (customer’s AD) on-premise
or VPN enabled authentication.
Level 3 Security (includes Level 2)
• Additional security customized to the customer’s existing
environment.
Level 4 On-Premise Security (independent option)
• Closed LAN environment.
• VPN
Enterprise Infrastructure
Storgrid – Secure, Compliant and Controlled
Although safety is paramount for all, security demands
across corporations are not equal. In recognition of varying
requirements, Storgrid can be adopted at various price
points adjusted to each client’s security requirements.
On-Access Virus Scanning
Even though corporate and government organizations usually require virus scanning on all devices, Storgrid adds an ex-
tra layer of security. Using On-Access virus scanning on the NetApp FAS, Storgrid ensures that no known virus will affect
a particular user, or related users, since data is scanned for viruses in real-time. If a virus is found, the file will be isolated
and appropriate action will be taken including notifying the impacted user and/or administrative team of the incident.
5. STORGRID RD • SCIENCE PARK 5630 • 5692 EN SON • NL
STORGRID EMEA • JADELAAN 99 • 2132 XZ HOOFDDORP • NL
STORGRID NORTH AMERICA • 505 North Brand Boulevard • 16th Floor • Glendale, CA 91203 • USA
Storgrid Operational Models
File Storage
The simplest and most obvious use of Storgrid is simply a new way to use home directory data. Currently users typically
store some files (not backed up in real-time) on their desktops, and others stored on file servers or NAS drives (not always
accessible). Both ways create ease of use and data protection issues. As Storgrid is designed to be the default local home
directory, it removes the risk of data loss and inaccessability. Storgrid provides a state of the art solution to long-standing
file storage issues regardless of whether the client chooses internal fileservers or NAS devices. With Storgrid’s offline
working and SnapShot features, users have 24/7 data access with the peace of mind that it is always recoverable after
loss, theft or even total corruptions caused by application or system meltdowns.
Multiple Device Sync
Traditionally, users had only one computing device, and data access was always simple and straightforward, and usually
only available at the office. Today, there is an abundance of computing devices. It is not atypical for a user to have a
Windows based laptop and a MAC device, and perhaps one or more other full size, portable or tablet computers at home
or even in the workplace. Storgrid can become a unifying factor, at least in data management, as the Storgrid client can
be installed on any number of devices using the same user account. This implies that as users upload files onto one
of their computing devices, Storgrid will automatically sync the data to the other devices in real-time when the user is
connected, and if not, the sync starts as soon as the user reconnects.
Virtual and Physical Desktop
With modern VDI (virtual desktop) technology, a user might have a physical PC/Laptop, from which a virtual desktop is
accessed. A problem arises when a user needs to transfer data between the virtual desktop and the physical desktop.
Even though the virtual and the physical desktops are running on the same hardware, there is no connection between
them that allows for simple file and data transfer/sync. In these cases, the Storgrid client can easily be installed on the
virtual as well as the physical OS of the user’s computer and any data activity will automatically be synced between the
devices, ensuring uninterrupted data access. Should a network outage render the virtual desktop unusable, the data up
until that point will already be synced and available from the physical desktop. When the network recovers, updates made
to the data on the physical machine are automatically available again on the virtual machine.
Collaborative Teamwork
Another obvious case is ‘team sharing’ - when an organization has project data which must be accessed by multiple team
members, perhaps located at different geographical locations, connected only via the internet. In this case, every team
member will have access to a shared folder in Storgrid which will constantly update all data additions and modifications to
the Storgrid server and the various users’ desktops. The real-time aspect is critical here, in order to avoid working on ob-
solete data. In the past users attached emails or used FTP or other inconvenient tools to transfer and share data in asyn-
chronous ways. This often led to frustration, lost productivity and unnecessary complexity in project management. Storgrid
effortlessly resolves these challenges and positions itself as the ideal tool for large and medium-sized global corporations
where hundreds of projects are running with various internal and external users participating from all over the world.
Functional Overview Local Client
• PC/MAC Client creates a Storgrid Drive, which syncs all data to the Storgrid cloud.
• Selected data can be kept on the local drive for best local performance.
• Browser based access over the Internet, for data access from any OS PC/Server platform.
• Mobile device accessibility for iPhone, iPad and Android mobile devices.
• User enabled data sharing and ‘team’ collaboration from all devices and interfaces.
• Sending folders and files via email link.
• Data always automatically synced between local client and cloud and vice versa.
• SnapShot guarantees file recovery, if necessary.
6. STORGRID RD • SCIENCE PARK 5630 • 5692 EN SON • NL
STORGRID EMEA • JADELAAN 99 • 2132 XZ HOOFDDORP • NL
STORGRID NORTH AMERICA • 505 North Brand Boulevard • 16th Floor • Glendale, CA 91203 • USA
The Storgrid Local Client
The Storgrid Client is installed on any Windows or MAC
computer. Simply copy any desired folders and/or files
into the Storgrid client drive or folder. This data will
automatically start ‘syncing’ data to the Storgrid platform.
When complete, all data will be available on the user’s
local PC, and on the server. Every file that is created or
modified will be immediately updated to the sever, for a
fully protected copy, and accessible from any browser
or mobile device. This client can be installed on multiple
computers under the same user account.
Once data is moved into the Storgrid disk, synchronization
starts automatically. When data sync is complete, various
folders can be ‘unchecked’ to remove data from the local
computer, while the data is still stored in the cloud, and is
accessible via any web-browser and mobile client.
If the user wishes to ‘resync’ data with the local computer,
clicking on the ‘check box’ of the desired folder, will make
the data automatically reappear. The user has total control
over local and remote storage.
Offline Sync
7. STORGRID RD • SCIENCE PARK 5630 • 5692 EN SON • NL
STORGRID EMEA • JADELAAN 99 • 2132 XZ HOOFDDORP • NL
STORGRID NORTH AMERICA • 505 North Brand Boulevard • 16th Floor • Glendale, CA 91203 • USA
Synchronization Overview
All folders or files placed in the Storgrid Disk will automatical-
ly be synchronized to the Storgrid server, unless previously
de-selected in the ‘offline folders’ menu. ‘Shared’ data from
collaborating members will also be synchronized.
‘Changes Pending‘ indicates how many files are being
synchronized in real-time to the server. Typically, perfor-
mance is based on the user’s Internet bandwidth.
Files and folders are first selected in the Storgrid folder and
then “sent” via a hyperlink to designated recipients’ email
accounts. To limit accessability, a user selects a time period
for which the data is available and can even request a
receipt notification. The recipients click the hyperlink to
view or download the data. There is no size limit for file
transfers, and no files are actually transmitted via email.
Data is simply served from the Storgrid cloud.
Sending Folders and Files
8. STORGRID RD • SCIENCE PARK 5630 • 5692 EN SON • NL
STORGRID EMEA • JADELAAN 99 • 2132 XZ HOOFDDORP • NL
STORGRID NORTH AMERICA • 505 North Brand Boulevard • 16th Floor • Glendale, CA 91203 • USA
Collaborative Team Sharing
By (right) clicking on any folder or file in Storgrid, a drop
down menu is presented giving the user the option to
‘share’. This will allow the local user to select collaborating
team members. These team members will see a local folder
appear under the lead user’s name in their ‘shared’ folder at
the top level of the Storgrid Disk.
Versions of all files are kept in Storgrid. By (right) clicking
on any file, a drop down menu for ‘previous versions‘ is
presented with the option to ‘restore’ or ‘delete’. This is
useful in case older versions need to be restored.
File Versioning
9. STORGRID RD • SCIENCE PARK 5630 • 5692 EN SON • NL
STORGRID EMEA • JADELAAN 99 • 2132 XZ HOOFDDORP • NL
STORGRID NORTH AMERICA • 505 North Brand Boulevard • 16th Floor • Glendale, CA 91203 • USA
Web Browser Access
Using the FireFox or Chrome browser, access the following
URL: https://connect.storgrid.com login with user credentials.
Files can be ‘dragdropped’ into the browser, or files can be
imported by selecting the ‘Browse’ button. By (right) clicking
on files or folders, various ‘sharing’, ‘sending’ and ‘previous
version’ options are offered. There’s a status bar at the
bottom of the browser to indicate upload progress. This
browser access is available from any internet connected
Windows, MAC or Linux OS, from anywhere in the world.
For technical questions, support or comments please
email: info@storgrid.com