Download to read offline
Uploaded byJon Wee
iStream360 Big Data Analytics Malaysia
Interstream Sdn. Bhd. offers the i360 intelligence suite, designed to enhance business strategies through data analytics utilizing open source technologies. Their cloud-based analytics platform, iStream360, addresses challenges in data management, providing scalable and cost-effective solutions for data ingestion, organization, and analytics. The company also offers ongoing support and training to empower organizations in leveraging their data assets for smarter decision-making.
More Related Content
Similar to iStream360 Big Data Analytics Malaysia
iStream360 Big Data Analytics Malaysia
- 1. i360 Enterprise Analytics InterstreamSdn. Bhd (1002739-D) Unit 29-01, Level 29, Tower A, Vertical Business Suite, Avenue 3, Bangsar South, No. 8, Jalan Kerinchi, 59200, Kuala Lumpur, Malaysia Tel: 03-27838406 Fax:03-27839666 connect@istream.my www.istream.my
- 2. 2 Not allowed toreproduce any parts of this article, illustrations and content of this proposal in any form or by any means electronic, mechanical, photocopying, recording or otherwise without prior written permission. Interstream Sdn. Bhd(1002739-D ) © All Rights Reserved. Private & Confidential
- 3. Powered by Data AtiStream, our vision is to empower businesses and organizations by harnessing the intelligence of data analytics using open source technologies and platforms. Our i360 intelligence suite will enable businesses to enhance their organization’s strategies based on data- driven deployments, effectively turning data into business decisions and smarter strategies. Dedicated to our client’s success, we are driven by innovation that matters and our solutions are developed to enable organizations to focus their efforts on more pertinent issues, to gain a sustainable edge in driving business and organizational innovations. 3
- 4. - Harness Valueand Insights from Analytics using iStream360 - Using iStream360 for holistic exploration and Client Strategy - Identifying key challenges in Data Management A smarter way forward… 4
- 5. Key Challenges inData Management DATA SILOS DATA VOLUMES NEW DATA SOURCES COSTS OF DATA PROCESSING • Multiple Data Silos • Often store overlapping and conflicting info • Issue compounded with multiple business units Care Product Catalog CRM Ordering Billing Legacy Enterprise Inventory OSS Network Customer Care Product Catalog Ordering Billing CRM Legacy Enterprise Inventory Supply Chain PoS • Data growing at ~100% YoY • A typical mobile service provider generates approx. 5 – 30 Billion Call Detail Records (CDRs) every day Clickstream Location/ GPS Call center Records Social Media • Semi/ Un-Structured Data Sources • Streaming/ Real-time data • Critical for building a True 360 view • Cost prohibitive • $30,000 and $100,000 (USD) per TB – Cost of storing data in relational database systems per year
- 6. iStream360 Enterprise Analyticsoffers a cost-efficient, open platform solution from collecting to optimizing data at large volumes. From ETL to AI offerings, our suite integrates with existing industry-standard software and platform providers. 6
- 7. 7 Benefits of iStream360Data lake: Scalability, Open Platform, Processing-speed, Schema, SQL-enabled, Lower Costs, Fast installation.
- 8. 8 How it works iStream360is a cloud-based analytics suite that takes the hard work out of data collection, organization, and transformation. Our next generation data lake uses open-platform technologies for scalable and cost effective operations. The data lake ingests, transforms, and integrates your data sources, then organizes the data for analytics, analytics user visualizations, advanced analytics development, machine learning or for exporting analytics to other systems. Our experts plan, implement, and manage the data lake in the cloud or on-premise to blend data from all sources. Our team provide analytics and advanced support to accelerate the translation of data into useful information and offer 24/7 ongoing operational support.
- 9. Why iStream360?iStream360 CoreOfferings i360 Data Analy cs Custom Built-to-Own Model Data Consultancy Data Management Advanced Modeling Big Data Training/ Corporate Awareness Data Migra on/ ETL Hardware/Cloud Integra on
- 10. Unified – Integratedanalytics system that connects data silos to a single data lake on cloud infrastructure. Self-Managed - Advanced management and workflow control through a self- serve user interface or managed by custom orchestrated workflow using Web API. Open Data Standards- Open architecture ensure data and applications to not to be need with proprietary vendors and technologies. Allows you to scale easily and cost effectively on the cloud as your data needs evolve. Fully managed and supported system - from system setup, to data source orchestration, to analytics visualization and 24X7 operations 10
- 11.
- 12. 12 Included with iStream360 •Targeted data sources, fully integrated into a data lake hosted on cloud provider of choice • Development and implementation of use cases translated into visualization • 24/7 ongoing operational support for maximum system availability and performance • Personalized ETL and/or analytics support • Unlimited conversations with iStream360 tech support about roadmap development and strategies Data Management Services • Custom algorithm development by our team of data scientists • Integration of addition data sources • Additional use cases • Real-time and streaming data support • Support for unstructured data • Advanced analytics development • Analytics sharing and collaboration • Data Governance and GDPR Privacy - Data Anonymization, Data Masking, API Strategy • Implementation of other cloud platform offerings • Performance management – Real-time dashboard and scorecard
- 13. 13 iConnect supports thefollowing input: • Text based files: txt, csv, tsv • Webservice and API: JSON, XML Proprietary format • PDF • Microsoft Access • Microsoft Excel Database Servers • Microsoft SQL Servers • MySQL • Oracle • Postgres Cloud • Google Analytics • Google BigQuery • Firebase • Amazon ElasticSearch • Microsoft Azure DB • Microsoft Azure DataLake The Data Connector API is a logical software layer that connects all data pipelines between your systems. It is responsible for establishing, maintaining, and monitoring that pipeline connectivity. It is statically linked to the existing system and dynamically linked to the data lake to maintain the recency of the data without affecting the other systems. Big Data • Hortonworks Hive • Cloudera Hive • Cloudera Impala • MapR Hadoop 2.0 • Microsoft Spark on HDInsight • Spark SQL iConnect
- 14. 14 iStream Data Lakeincludes all the capabilities to make it easy to store data of any size, shape, and speed. It supports all types of processing and analytics across platforms and languages. It removes the complexities of ingesting and storing data while making it faster to get up and running analytics. iStream Data Lake works with existing IT setup and integrates seamlessly with data warehouses so you can extend current data applications and perform analytics without affecting production databases. iStream Data Lake addresses many of the productivity and scalability challenges that prevent you from maximizing the value of your data assets with potential AI capabilities that answer your business questions. Data stored in object format to allow easy slice and dice operations without limiting to predefined data structure.
- 15. 15 iView is avisualization engine layer that allows users to create business reports, visualization using open source charting library or work with existing BI tools. Drill down, filter and interact with a live dashboard, find answers and make informed decisions with iView analytics capabilities. Build dashboard and generating reports using a software your team is familiar to reduce learning curve, allow key personnel to access and consolidate data in a few clicks.
- 16. CONSOLIDATED VISUALISATION –iView 360 With the large amounts of data coming from various data sources, the iView suite integrates all the information and presents it in a unified way for easy visualization of collected data. Engagement: View detailed reports on website activity as a result of social media activity Benchmarking: View how your brand is doing against your competitors Monitoring: Measure the performance of your own content 16
- 17. i360 Machine Learning iDataMachine Learning explores the study and construction of algorithms that can learn from and make predictions from collected data. COMMON METHODS Classification Regression Segmentation i360 Predictive Analytics Functionality / Use Case • Predicting Lifetime Value (LTV) • Predicting Churn • Customer Segmentation • Product Recommendations • Treasury or Currency Risk • Fraud Detection • Accounts Payable Recovery • Predicting Credit Risk • Spam Filtering • Resume Screening • Talent Training & Management 17
- 18. Big Data Training& Education Partners 18 Whether you're pursuing a far–reaching initiative or implementing smaller business analytics programs, we can help you achieve the smarter outcomes with the right training classes from corporate awareness to technical sessions on big data technologies and applications. Training classes are delivered by certified industry trainers and business specialists who are firmly grounded in your industry. This is where the science of analytics becomes a reality in your business. Contact us today for more information connect@istream.my
- 19. iConsult – Training& Education 19
- 20. Microsoft Data ScienceCourse Module 20
- 21. Portfolio Client Projects JOHORCORP - Development of in-house analytics suite for Johor Corporation, Malaysia Intel Malaysia - Test Driven Design (using data to automate testing) - Design Pattern (create reusable software that can scale) - Big Data Training Jabil - AngularJS2 Single Page Application Development Big Data Training Standard Chartered Bank - Big Data Architecture Design Developer training for Spark and Hadoop Microsoft e-Research Centre, Australia - IoT development, sensors for data collection in the study of Australian natural habitats Institute of Future Environments, Australia - Data extraction for studies in GHG ( Greenhouse Gas ) Malaysia Digital Economy Corporation - Development of MDEC's Data Cleansing platform Malaysia Qualification Agency Selangor State Government -Big Data Training and certification, Ongoing 21 Brightlights Broadcasting Corporation, U.S.A - InHome Healthcare Analytics
- 22. Interstream Sdn. Bhd(1002739-D) Unit 29-01, Level 29, Tower A, Vertical Business Suite, Avenue 3, Bangsar South, No. 8, Jalan Kerinchi, 59200, Kuala Lumpur, Malaysia Tel: 03-27838406 Fax:03-27839666 www.istream.my Get in touch with us today! connect@istream.my 22
Editor's Notes
- #13 An enterprise data hub addresses each of the earlier challenges: 1. You can keep unlimited data online, in its original fidelity and format. As a data staging area, it can serve as an automatic archive of any data sent to it, and process that data quickly and cost-effectively. 2. Diverse users can get direct access to all business relevant data, through the best tool for the job, whether that’s SQL, search, programming, or a favorite BI or analytics tools. Users who previously had no way to benefit from data can now find and generate insights. 3. All of this can be done with confidence, thanks to Cloudera’s enterprise-grade security, governance, and management tools. An enterprise data hub unlocks more value, from more data, for more users, in less time. Representative Customer Stories Costco: From disparate and limited data views to unlimited information access. Challenge: Costco set out to refine their global data center without disrupting the existing heterogeneous environment consisting of Informatica, Oracle, Teradata, IBM, and others. A short term goal was to find a new solution for their transaction log (TLOG) processing, which was a bottleneck on the incumbent DB2 system that resulted in throwing data away. Solution: Costco implemented Cloudera on Cisco UCS hardware to integrate their many different in-house technologies within an interconnected enterprise data hub environment, leveraging tools including Impala, Mahout, Spark, and Solr to support a variety of user requirements and workloads. Benefit: Costco no longer throws data away, and their data processing performance has been accelerated, while alleviating at least 20% of the load on IBM systems. The traditional infrastructure is 100X more costly than Cloudera combined with Cisco hardware, so any relief on the legacy environment saves the company substantially. Their ultimate goal is to be able to capture and process all incoming data for a more comprehensive understanding of product movement by location, driving smarter decisions in market research and procurement strategy. SFR: From analytics for some to insights for all. Challenge: SFR’s data warehouse has served the company well for ten years, containing data on products, device usage, invoices, contracts, price plans, and call detail records (CDR), but SFR wanted to create a shared, detailed view into the customer journey -- available to employees across the company -- for real-time search, reporting, and analysis, while also aiming to bring in multi-structured data from new sources. Solution: By complementing its data warehouse infrastructure with Cloudera Enterprise, Data Hub Edition, SFR is delivering the 360-degree view that will help the company optimize its customer journey. SFR’s 9,000+ employees now have access to a self-service discovery environment enabling query and exploration of a single, centralized data store. Benefit: Employees across the country can now operate based on a centralized, real-time customer view that spans many devices and data sources. And by offloading large-scale data ingest, processing, and exploration of multi-structured data sets from the data warehouse to Cloudera, the data warehouse will deliver optimal system performance for 8-9 years, vs. needing an upgrade every 3 years. MasterCard: From risk due to regulation and customer privacy concerns to trust in a secure and compliant platform. Challenge: Given the growing importance of Hadoop in MasterCard's long-term enterprise data hub strategy, its Cloudera platform required PCI Certification to allow Hadoop to not only host PCI or potentially PCI datasets, but to also be able to integration with other PCI-certified environments. Solution: MasterCard's Cloudera environment -- which is a key component to the company's overarching enterprise data hub strategy -- has been certified by an external auditor to fully conform to the PCI DSS V 2.0 Security standard. Benefit: Achieving PCI compliance on its Cloudera environment is not only important in the evaluation of current workload suitability for Hadoop at MasterCard, but also for a new generation of applications and datasets that can now be hosted on the Cloudera platform which require a PCI Certified environment.