Rails on HBase

Cassandra Introduction & Features

Phil Peace

Cassandra is an open source, distributed, decentralized, and fault-tolerant NoSQL database that is highly scalable and provides tunable consistency. It was created at Facebook based on Amazon's Dynamo and Google's Bigtable. Cassandra's key features include elastic scalability through horizontal partitioning, high availability with no single point of failure, tunable consistency levels, and a column-oriented data model with a CQL interface. Major companies like eBay, Netflix, and Apple use Cassandra for applications requiring large volumes of writes, geographical distribution, and evolving data models.

HBaseCon 2012 | Building a Large Search Platform on a Shoestring Budget

This document discusses YapMap, a visual search platform built on Hadoop and HBase. It summarizes how YapMap interfaces with HBase data, uses HBase as a data processing pipeline with checkpoints, and had to adjust schemas and migrate data as the system evolved. It also covers how YapMap constructs search indexes in shards based on HBase regions and stored indexes on HDFS. The document concludes with some lessons learned around optimizing HBase operations.

HBaseConEast2016: HBase and Spark, State of the Art

HBase is a distributed, column-oriented database that stores data in tables divided into rows and columns. It is optimized for random, real-time read/write access to big data. The document discusses HBase's key concepts like tables, regions, and column families. It also covers performance tuning aspects like cluster configuration, compaction strategies, and intelligent key design to spread load evenly. Different use cases are suitable for HBase depending on access patterns, such as time series data, messages, or serving random lookups and short scans from large datasets. Proper data modeling and tuning are necessary to maximize HBase's performance.

Cloudera Impala: A Modern SQL Engine for Hadoop

Swiss Big Data User Group

Cloudera Impala is a modern SQL query engine for Apache Hadoop that provides high performance for both analytical and transactional workloads. It runs directly within Hadoop clusters, reading common Hadoop file formats and communicating with Hadoop storage systems. Impala uses a C++ implementation and runtime code generation for high performance compared to other Hadoop SQL query engines like Hive that use Java and MapReduce.

Cloudera impala

James Kinley from Cloudera: An introduction to Cloudera Impala. Cloudera Impala provides fast, interactive SQL queries directly on your Apache Hadoop data stored in HDFS or HBase. In addition to using the same unified storage platform, Impala also uses the same metadata, SQL syntax (Hive SQL), ODBC driver and user interface (Hue Beeswax) as Apache Hive. This provides a familiar and unified platform for batch-oriented or real-time queries. The link to the video: http://zurichtechtalks.ch/post/37339409724/an-introduction-to-cloudera-impala-sql-on-top-of

Introduction to Impala

markgrover

Impala is an open source SQL query engine for Apache Hadoop that allows real-time queries on large datasets stored in HDFS and other data stores. It uses a distributed architecture where an Impala daemon runs on each node and coordinates query planning and execution across nodes. Impala allows SQL queries to be run directly against files stored in HDFS and other formats like Avro and Parquet. It aims to provide high performance for both analytical and transactional workloads through its C++ implementation and avoidance of MapReduce.

HBaseCon 2015: Graph Processing of Stock Market Order Flow in HBase on AWS

HBaseConEast2016: Splice machine open source rdbms

This document discusses Splice Machine, an open source RDBMS that runs queries using Apache Spark for analytics and Apache HBase for transactions. It provides concise summaries of how Splice Machine executes queries by parsing SQL, optimizing query plans, and generating byte code to run queries on either HBase or Spark. It also benchmarks Splice Machine's performance on loading and running TPCH queries compared to other systems like Phoenix and shows how it enables advanced Spark integration by creating RDDs directly from HFiles.

Building Google-in-a-box: using Apache SolrCloud and Bigtop to index your big...

rhatr

You’ve got your Hadoop cluster, you’ve got your petabytes of unstructured data, you run mapreduce jobs and SQL-on-Hadoop queries. Something is still missing though. After all, we are not expected to enter SQL queries while looking for information on the web. Altavista and Google solved it for us ages ago. Why are we still requiring SQL or Java certification from our enterprise bigdata users? In this talk, we will look into how integration of SolrCloud into Apache Bigtop is now enabling building bigdata indexing solutions and ingest pipelines. We will dive into the details of integrating full-text search into the lifecycle of your bigdata management applications and exposing the power of Google-in-a-box to all enterprise users, not just a chosen few data scientists.

Apache phoenix

University of Moratuwa

This document summarizes a presentation about Apache Phoenix, an open-source project that allows HBase to be queried with SQL. It discusses what Phoenix is, why tracing is important, and the features of a new tracing web app created for Phoenix, including listing traces, visualizing trace distributions and individual trace details. Programming challenges in creating the app and new issues filed are also summarized.

HBaseConEast2016: How yarn timeline service v.2 unlocks 360 degree platform i...

12 SQL On-Hadoop Tools

Xplenty

This document discusses 12 tools that bring SQL functionality to Apache Hadoop in various ways. It describes open source tools like Apache Hive, Apache Sqoop, BigSQL, Lingual, Apache Phoenix, Impala, and Presto. It also covers commercial tools like Hadapt, Jethro Data, HAWQ, and Xplenty that provide SQL capabilities on Hadoop. The tools allow querying and analyzing large datasets stored on Hadoop using SQL or SQL-like languages in either batch or interactive modes.

An Introduction to Impala – Low Latency Queries for Apache Hadoop

Impala is a massively parallel processing SQL query engine for Apache Hadoop. It allows real-time queries on large datasets by using a new execution engine written in C++ instead of Java and MapReduce. Impala can process queries in milliseconds to hours by distributing query execution across Hadoop clusters. It uses existing Hadoop file formats and metadata but is optimized for performance through techniques like runtime code generation and in-memory processing.

What Every Developer Should Know About Database Scalability

jbellis

Replication. Partitioning. Relational databases. Bigtable. Dynamo. There is no one-size-fits-all approach to scaling your database, and the CAP theorem proved that there never will be. This talk will explain the advantages and limits of the approaches to scaling traditional relational databases, as well as the tradeoffs made by the designers of newer distributed systems like Cassandra. These slides are from Jonathan Ellis's OSCON 09 talk: http://en.oreilly.com/oscon2009/public/schedule/detail/7955

Cloudera Impala: A Modern SQL Engine for Apache Hadoop

Impala is a massively parallel processing SQL query engine for Apache Hadoop. It allows real-time queries on large datasets using existing SQL skills. Impala's architecture includes impalad daemons that process queries in parallel across nodes, a statestore for metadata coordination, and a new execution engine written in C++. It aims to provide faster performance than Hive for interactive queries while leveraging Hadoop's existing ecosystem. The first general availability release is planned for April 2013.

#GeodeSummit - Integration & Future Direction for Spring Cloud Data Flow & Geode

PivotalOpenSourceHub

HBaseCon 2012 | HBase, the Use Case in eBay Cassini

eBay marketplace has been working hard on the next generation search infrastructure and software system, code-named Cassini. The new search engine processes over 250 million search queries and serves more than 2 billion page views each day. Its indexing platform is based on Apache Hadoop and Apache HBase. Apache HBase is a distributed persistent layer built on Hadoop to support billions of updates per day. Its easy sharding character, fast writes, and table scans, super fast data bulk load, and natural integration to Hadoop provide the cornerstones for successful continuous index builds. We will share with the audience the technical details and share the difficulties and challenges that we’ve gone through and that we are still facing in the process.

Using HBase Co-Processors to Build a Distributed, Transactional RDBMS - Splic...

John Leach Co-Founder and CTO of Splice Machine with 15+ years software development and machine learning experience will discuss how to use HBase co-processors to build an ANSI-99 SQL database with 1) parallelization of SQL execution plans, 2) ACID transactions with snapshot isolation and 3) consistent secondary indexing. Transactions are critical in traditional RDBMSs because they ensure reliable updates across multiple rows and tables. Most operational applications require transactions, but even analytics systems use transactions to reliably update secondary indexes after a record insert or update. In the Hadoop ecosystem, HBase is a key-value store with real-time updates, but it does not have multi-row, multi-table transactions, secondary indexes or a robust query language like SQL. Combining SQL with a full transactional model over HBase opens a whole new set of OLTP and OLAP use cases for Hadoop that was traditionally reserved for RDBMSs like MySQL or Oracle. However, a transactional HBase system has the advantage of scaling out with commodity servers, leading to a 5x-10x cost savings over traditional databases like MySQL or Oracle. HBase co-processors, introduced in release 0.92, provide a flexible and high-performance framework to extend HBase. In this talk, we show how we used HBase co-processors to support a full ANSI SQL RDBMS without modifying the core HBase source. We will discuss how endpoint transactions are used to serialize SQL execution plans over to regions so that computation is local to where the data is stored. Additionally, we will show how observer co-processors simultaneously support both transactions and secondary indexing. The talk will also discuss how Splice Machine extended the work of Google Percolator, Yahoo Labs’ OMID, and the University of Waterloo on distributed snapshot isolation for transactions. Lastly, performance benchmarks will be provided, including full TPC-C and TPC-H results that show how Hadoop/HBase can be a replacement of traditional RDBMS solutions. To view the accompanying slide deck: http://www.slideshare.net/ChicagoHUG/

Ansible for large scale deployment

Scaling MySQL using Fabric

Solr cloud the 'search first' nosql database extended deep dive

lucenerevolution

Presented by Mark Miller, Software Engineer, Cloudera As the NoSQL ecosystem looks to integrate great search, great search is naturally beginning to expose many NoSQL features. Will these Goliath's collide? Or will they remain specialized while intermingling – two sides of the same coin. Come learn about where SolrCloud fits into the NoSQL landscape. What can it do? What will it do? And how will the big data, NoSQL, Search ecosystem evolve. If you are interested in Big Data, NoSQL, distributed systems, CAP theorem and other hype filled terms, than this talk may be for you.

Impala Architecture presentation

hadooparchbook

Richard Dixon, Black Sun, Why they won: Online corporate reporting

Communicate magazine - Chris North and Anita Knowles

DataWorks Summit/Hadoop Summit

What's hot

HBase in Practice

Cloudera Impala: A Modern SQL Engine for Hadoop

Swiss Big Data User Group

Cloudera impala

Introduction to Impala

markgrover

HBaseCon 2015: Graph Processing of Stock Market Order Flow in HBase on AWS

HBaseConEast2016: Splice machine open source rdbms

Building Google-in-a-box: using Apache SolrCloud and Bigtop to index your big...

rhatr

Apache phoenix

University of Moratuwa

HBaseConEast2016: How yarn timeline service v.2 unlocks 360 degree platform i...

12 SQL On-Hadoop Tools

Xplenty

An Introduction to Impala – Low Latency Queries for Apache Hadoop

What Every Developer Should Know About Database Scalability

jbellis

Cloudera Impala: A Modern SQL Engine for Apache Hadoop

#GeodeSummit - Integration & Future Direction for Spring Cloud Data Flow & Geode

PivotalOpenSourceHub

HBaseCon 2012 | HBase, the Use Case in eBay Cassini

Using HBase Co-Processors to Build a Distributed, Transactional RDBMS - Splic...

Ansible for large scale deployment

Scaling MySQL using Fabric

Solr cloud the 'search first' nosql database extended deep dive

lucenerevolution

Impala Architecture presentation

hadooparchbook

What's hot (20)

HBase in Practice

Cloudera Impala: A Modern SQL Engine for Hadoop

Cloudera impala

Introduction to Impala

HBaseCon 2015: Graph Processing of Stock Market Order Flow in HBase on AWS

HBaseConEast2016: Splice machine open source rdbms

Building Google-in-a-box: using Apache SolrCloud and Bigtop to index your big...

Apache phoenix

HBaseConEast2016: How yarn timeline service v.2 unlocks 360 degree platform i...

12 SQL On-Hadoop Tools

An Introduction to Impala – Low Latency Queries for Apache Hadoop

What Every Developer Should Know About Database Scalability

Cloudera Impala: A Modern SQL Engine for Apache Hadoop

#GeodeSummit - Integration & Future Direction for Spring Cloud Data Flow & Geode

HBaseCon 2012 | HBase, the Use Case in eBay Cassini

Using HBase Co-Processors to Build a Distributed, Transactional RDBMS - Splic...

Ansible for large scale deployment

Scaling MySQL using Fabric

Solr cloud the 'search first' nosql database extended deep dive

Impala Architecture presentation

Viewers also liked

Richard Dixon, Black Sun, Why they won: Online corporate reporting

Communicate magazine - Chris North and Anita Knowles

Ppt

skeeboy12

Social computing intro

Lane Severson

This document provides an agenda and objectives for a discussion on planning for Enterprise 2.0. The discussion will cover cultural and behavioral transformation, use cases, technology trends, and execution mechanics. The key theme is enabling knowledge workers with social computing and collaboration tools to drive growth, improve efficiency, and gain governance over organizational information. The primary objective is to provide best practices for using collaboration technologies strategically while addressing impacts, risks, and deployment. The session will argue that consumer behaviors will influence the workplace and companies that create collaborative environments will benefit from their people, but governance principles will need to apply to open communication.

Kam præsentation april 2010Joehl

I No Longer Have Enough Faith To Be An Atheist

jyakkudesu

The document discusses the author's journey from atheism to Christianity. As a child of an atheist scientist, the author was also an atheist who believed life had no ultimate meaning. However, after various life experiences and examining the relationship between science, mathematics, and religion, the author became convinced of Christianity and God's existence. The author cites many prominent scientists in history who were devout Christians and argues that science provides evidence for rather than against the existence of God.

Chris Taylor, Future plc, Strategic Thought

GST - 24 Things you should know about Draft GST Rules & Forms

Taxmann

This document provides a summary of 24 key points about the draft GST rules and forms released by the Central Board of Excise and Customs (CBEC) related to registration, invoices, returns, payments, and refunds under the Goods and Services Tax (GST) regime in India. Some highlights include that registration applications will be made online, invoices must include additional details for large unregistered recipients, returns will involve filing outward supply details in Form GSTR-1 and inward supply details in Form GSTR-2, payments will involve electronic ledgers to track tax liability, credits, and amounts paid, and refund claims can receive provisional refunds of 80% under certain conditions.

Putting Twitter to work for you

Imperva

Enterprise social media studiedag hogescholenraadMarijn Somers

Mining brochureguestd2b500

Sac prep and soi

Paul

The document provides guidance for students working on an essay assignment, including prompts for discussion, examples of student responses, and notes on key elements to address such as form, language, audience, purpose, and context (FLAPC). It encourages unpacking the prompt, stating intentions, and discussing choices in writing. Sample activities include completing a grouping prompt, reading example essays, and creating a statement of intention or explanation.

Industrial relations

arpita7

The document discusses statutory and non-statutory labour welfare facilities. Statutory facilities are those required by law, like cleanliness, drinking water, medical facilities, and rest areas. Non-statutory facilities are provided voluntarily by management and include transportation, education, housing allowances, and recreation. Statutory welfare schemes ensure facilities like drinking water, seating, first aid, washrooms, and cafeterias. Non-statutory schemes provide health checks, flexible schedules, counseling, insurance, and employee referrals. Facilities are further divided into intramural activities provided on-site, and extramural activities undertaken off-site.

1405 лекция

Aleksey Zharkov

Open Government Implementation Model - Internal Data Monitoring - CeDEM 2012

Bernhard Krabina

How i generated a response

HanaEllis

The student tried using polls on their blog to get feedback on their work from peers, but found it unsuccessful as they did not receive much feedback unless prompting others repeatedly. Comments boxes from teachers provided some useful feedback during non-contact hours. Speaking to peers and teachers directly about work proved to be the most useful way for the student to get feedback, as others could point out specific issues and the teachers could demonstrate in real time how to improve.

Doculabs E Discovery 051710

Lane Severson

The document discusses tactical concerns for e-discovery efforts, including the rapid growth of information types, user experience and information organization challenges, and economics and cost justification issues. It notes the increasing variety of content types, issues with manual metadata entry, and challenges justifying investments. Simplified taxonomies and context-driven metadata can improve the user experience. Costs include penalties, storage, and labor, but savings are difficult to quantify across departments.

Computers

arez esmail

Computers started becoming popular with businesses in the 1960s and widespread in homes and schools in the 1980s. People now use computers for many purposes like banking, education, research, engineering, design, law enforcement, the military and more. Computers require both hardware, like processors, memory, and peripheral devices, as well as software programs and operating systems to function. Early pioneers invented the foundations of modern computers, but it was not until integrated circuits and transistors that computers became small enough for personal use in the 1970s and 1980s.

Albània

Joan Torrecillas

Ventajas y desventajas de las tics

tchdelacruz

Viewers also liked (20)

Richard Dixon, Black Sun, Why they won: Online corporate reporting

Communicate magazine - Chris North and Anita Knowles

Ppt

Social computing intro

Kam præsentation april 2010

I No Longer Have Enough Faith To Be An Atheist

Chris Taylor, Future plc, Strategic Thought

GST - 24 Things you should know about Draft GST Rules & Forms

Putting Twitter to work for you

Enterprise social media studiedag hogescholenraad

Mining brochure

Sac prep and soi

Industrial relations

1405 лекция

Open Government Implementation Model - Internal Data Monitoring - CeDEM 2012

How i generated a response

Doculabs E Discovery 051710

Computers

Albània

Ventajas y desventajas de las tics

Similar to Rails on HBase

impalapresentation-130130105033-phpapp02 (1)_221220_235919.pdf

ssusere05ec21

Impala is a SQL query engine for Apache Hadoop that allows real-time queries on large datasets. It is designed to provide high performance for both analytical and transactional workloads by running directly on Hadoop clusters and utilizing C++ code generation and in-memory processing. Impala uses the existing Hadoop ecosystem including metadata storage in Hive and data formats like Avro, but provides faster performance through its new query execution engine compared to traditional MapReduce-based systems like Hive. Future development of Impala will focus on improved support for features like HBase, additional SQL functionality, and query optimization.

Large-scale Web Apps @ Pinterest

Speaker: Varun Sharma (Pinterest) Over the past year, HBase has become an integral component of Pinterest's storage stack. HBase has enabled us to quickly launch and iterate on new products and create amazing pinner experiences. This talk briefly describes some of these applications, the underlying schema, and how our HBase setup stays highly available and performant despite billions of requests every week. It will also include some performance tips for running on SSDs. Finally, we will talk about a homegrown serving technology we built from a mashup of HBase components that has gained wide adoption across Pinterest.

[Hi c2011]building mission critical messaging system(guoqiang jerry)

baggioss

Building Mission Critical Messaging System On Top Of HBase Facebook chose HBase as the storage system for its messaging platform due to HBase's high write throughput, good random read performance, horizontal scalability, and automatic failover. Facebook stores messages, metadata, and search indices in HBase. To improve performance and reliability, Facebook developed the system on a production-stabilized branch of HBase, used shadow testing, added extensive monitoring, and contributed improvements back to the HBase community.

Impala presentation

trihug

Facebook keynote-nicolas-qcon

Yiwei Ma

This document summarizes a talk about Facebook's use of HBase for messaging data. It discusses how Facebook migrated data from MySQL to HBase to store metadata, search indexes, and small messages in HBase for improved scalability. It also outlines performance improvements made to HBase, such as for compactions and reads, and future plans such as cross-datacenter replication and running HBase in a multi-tenant environment.

Facebook Messages & HBase

强王

The document discusses Facebook's use of HBase to store messaging data. It provides an overview of HBase, including its data model, performance characteristics, and how it was a good fit for Facebook's needs due to its ability to handle large volumes of data, high write throughput, and efficient random access. It also describes some enhancements Facebook made to HBase to improve availability, stability, and performance. Finally, it briefly mentions Facebook's migration of messaging data from MySQL to their HBase implementation.

支撑Facebook消息处理的h base存储系统

yongboy

The document discusses Facebook's use of HBase as the database storage engine for its messaging platform. It provides an overview of HBase, including its data model, architecture, and benefits like scalability, fault tolerance, and simpler consistency model compared to relational databases. The document also describes Facebook's contributions to HBase to improve performance, availability, and achieve its goal of zero data loss. It shares Facebook's operational experiences running large HBase clusters and discusses its migration of messaging data from MySQL to a de-normalized schema in HBase.

HBaseCon 2013: HBase SEP - Reliable Maintenance of Auxiliary Index Structures

HBase SEP & Indexer provide a mechanism for triggering and processing side effects and updates to other systems like Solr based on changes to HBase data. They leverage HBase replication to pass update events to a lightweight Indexer process that maps the changes to Solr. This allows structured search of HBase data in Solr without impacting the HBase write path and provides a way to perform indexing without running code on HBase region servers. The open source tools support various mapping, extraction, and indexing configurations and deployment options.

AWS re:Invent 2016: Streaming ETL for RDS and DynamoDB (DAT315)

Amazon Web Services

During this session Greg Brandt and Liyin Tang, Data Infrastructure engineers from Airbnb, will discuss the design and architecture of Airbnb's streaming ETL infrastructure, which exports data from RDS for MySQL and DynamoDB into Airbnb's data warehouse, using a system called SpinalTap. We will also discuss how we leverage Spark Streaming to compute derived data from tracking topics and/or database tables, and HBase to provide immediate data access and generate cleanly time-partitioned Hive tables.

Intro to HBase - Lars George

JAX London

Apache HBase™

Prashant Gupta

The document provides an introduction to NoSQL and HBase. It discusses what NoSQL is, the different types of NoSQL databases, and compares NoSQL to SQL databases. It then focuses on HBase, describing its architecture and components like HMaster, regionservers, Zookeeper. It explains how HBase stores and retrieves data, the write process involving memstores and compaction. It also covers HBase shell commands for creating, inserting, querying and deleting data.

HBase and Hadoop at Urban Airship

dave_revell

Hive 3 - a new horizon

Thejas Nair

Apache Hive 3 introduces new capabilities for data analytics including materialized views, default columns, constraints, and improved JDBC and Kafka connectors to enable real-time streaming and integration with external systems like Druid; Hive 3 also improves performance and query optimization through a new query result cache, workload management, and cloud storage optimizations. Data Analytics Studio provides self-service analytics on top of Hive 3 through a visual interface to optimize queries, monitor performance, and manage data lifecycles.

Facebook architecture

drewz lin

Facebook uses a LAMP stack with additional services and customizations for its architecture. The LAMP stack includes PHP, MySQL, and Memcache. PHP is used for its web programming capabilities but has scaling issues. MySQL is used primarily as a key-value store and is optimized for recency of data. Memcache provides high-performance caching. Additional services are implemented using Thrift for cross-language communication and include News Feed, Search, and Scribe for logging. Services allow storing code closer to data in more efficient compiled languages.

Qcon 090408233824-phpapp01

jgregory1234

Facebook uses a LAMP stack with additional services and customizations for its architecture. PHP and MySQL are used for the main web and data tiers but have limitations for large scale. Services are implemented using Thrift for cross-language communication and Scribe for distributed logging. Services allow storing code closer to data and using optimized languages. The News Feed and Search architectures distribute work across tiers with Thrift calls and aggregate data using services.

Facebook的架构

yiditushe

Facebook uses a LAMP stack with additional services and customizations for its architecture. PHP and MySQL are used for the main web and data tiers but have limitations for large scale. Services are implemented using Thrift for cross-language communication and Scribe for distributed logging. Services allow storing code closer to data and using optimized languages. The News Feed and Search architectures incorporate services, distributed data storage, and caching to provide personalized experiences for over 120 million active users.

Facebook architecture

mysqlops

Facebook uses a LAMP stack with additional services and customizations for its architecture. The LAMP stack includes PHP, MySQL, and Memcache. PHP is used for its web programming capabilities but has scaling issues. MySQL is used primarily as a key-value store and is optimized for recency of data. Memcache provides high-performance caching. Additional services are created using Thrift for tasks better suited to other languages. Services include News Feed, Search, and logging via Scribe. The architecture emphasizes scalability, simplicity, and optimizing for common use cases.

Hw09 Practical HBase Getting The Most From Your H Base Install

Cloudera Operational DB (Apache HBase & Apache Phoenix)

Timothy Spann

Big data processing engines, Atlanta Meetup 4/30

Ashish Narasimham

Similar to Rails on HBase (20)

impalapresentation-130130105033-phpapp02 (1)_221220_235919.pdf

Large-scale Web Apps @ Pinterest

[Hi c2011]building mission critical messaging system(guoqiang jerry)

Impala presentation

Facebook keynote-nicolas-qcon

Facebook Messages & HBase

支撑Facebook消息处理的h base存储系统

HBaseCon 2013: HBase SEP - Reliable Maintenance of Auxiliary Index Structures

AWS re:Invent 2016: Streaming ETL for RDS and DynamoDB (DAT315)

Intro to HBase - Lars George

Apache HBase™

HBase and Hadoop at Urban Airship

Hive 3 - a new horizon

Facebook architecture

Qcon 090408233824-phpapp01

Facebook的架构

Facebook architecture

Hw09 Practical HBase Getting The Most From Your H Base Install

Cloudera Operational DB (Apache HBase & Apache Phoenix)

Big data processing engines, Atlanta Meetup 4/30

More from EffectiveUI

Design essentials For Executives

You’ve embarked upon a user experience project – updating your website or creating a Web or mobile app. You know there will be an element of visual and experience design, but do you understand the basics behind why your designers are making the decisions and recommendations they make? It’s important to understand some design basics in order to communicate effectively with the designers on your team. While many of us have an intuitive feel for what works and what doesn’t, developing a vocabulary to describe your issues and feedback and understanding the techniques required to validate your hunches are important skills in order to ensure the success of your project. This session goes in-depth on which design techniques and principles ought to be part of every executive’s vernacular. By the end of the session attendees will understand the basics of both high level interaction design and lower-level visual design in a way that maximizes energy and time in the approval process, including: • Basic design principles to help executives understand a design’s intent. This includes a basic understanding of layout, color theory and typography. • Design vocabulary, heuristics and analysis techniques • The difference between information architecture and interaction design, and how both have a critical yet often unseen influence on the development of the end project • Why incorporating user research is critical to good design

Designing an App: From Idea to Market

Flash and Flex in an HTML5 / App Store World

Design Essentials for Developers 08.31.11

The document discusses essential design principles for developers to improve understanding, communication and collaboration with designers. It covers design research, interaction design and graphic design. The presentation emphasizes making intent visible through ensuring interactive elements are visible, recognizable, have feedback, and are safe and consistent. It encourages developers to validate their ideas through quick user interviews, and to appreciate good design while avoiding some common mistakes.

Flex4 Component Lifecycle

The Art of Interaction

Design Essentials for Developers

Git for the Android Developer

Whether you work alone or in a team, some sort of source control management is essential to you as a developer for things like keeping a history of your code, dealing with integrating code, managing releases and making your development workflow through different features painless. If you're coming from something like CVS or SVN, the open-source Git version control system will turn what you know of SCM on its head. This presentation explains why Git is different, and what that difference means to you as an Android developer.

Microsoft Kinect and Molehill

Reasons for Flash: Flash Development in an HTML5 and App Store World

Flash will continue to be valuable for enterprise applications, multi-screen development, leveraging the large community of developers and libraries, playing video due to HTML5's lack of DRM and compatibility issues, games due to better performance than HTML5, and translating interaction models through established design principles. While HTML5 and native apps are emerging, Flash still provides benefits in these key areas.

Discombobulation, Fire-Breathing Dragons and Wet Noodles: Creating Productive...

The document provides tips for facilitating productive workshops in scary situations. It discusses strategies for dealing with non-participation, over-participation by one person, negative attitudes, stakeholder shutdown, fixed mindsets, and lack of consensus. Suggested activities include pair and share, sticky note exercises, design games, empathy maps, and dot voting. The overall message is for the facilitator to own the process, share ownership of outcomes, and be prepared to adjust the agenda dynamically based on participant behavior and progress.

Design Essentials for Developers

The document discusses design essentials for developers, including the importance of a common design language between developers and designers. It covers different aspects of design like research, interaction design, and graphic design. Some key principles discussed include visibility, affordances, feedback, mapping, consistency, and using design research to validate designs. The document emphasizes that developers already do design in their work and should feel empowered to design, but also to respect designers and appreciate good design work. It suggests validating design ideas with quick user interviews.

Your Mom Has an iPad

EffectiveUI lead user experience architect John McRee's presentation from South by Southwest Interactive 2011: "It’s a cultural phenomenon that most of us didn’t see coming: baby boomers are taking over Facebook, while the millenials are abandoning it like crazy because it is so last year. After all, what 20-something wants his mom to see his status update about last night’s party? This example signifies a trend in technology overall: the assumed late adopters are now joining early adopters as technology becomes increasingly easy and fun to use. Devices such as the Wii and the iPad have overwhelmingly been adopted by the older and less technologically savvy crowd. The trend has significant design implications. As we’re designing for emergent devices, we need to be very aware that we’re definitely not designing for ourselves. User research will become even more critical, with particular attention paid to the more mature crowd as they have different needs from other generations..."

Human-Centered Design and the Intersection of the Physical and Digital Worlds

From the Trenches: Building the Accessible Web

The document discusses building accessible websites from a practical perspective. It addresses how accessibility can fall by the wayside due to roadblocks from stakeholders, designers, and developers. It advocates keeping goals realistic and using progressive enhancement, where the basic accessible content and structure is provided first before other enhancements. An example project for the Blue Angels website is described where progressive enhancement was applied during the definition, design, and development phases while maintaining an audit trail.

Flexerific Visual Effects

Leonard Souza presents this look at Flex's amazing built-in visual effects and filters, which are probably one of the primary reasons to use the framework over other RIA platforms. As it turns out they are relatively easy to create. This presentation - given at 360|Flex in September 2010 - dives into the drawing API, the base effect/filter classes and Pixel Bender. You’ll learn how to build them from the ground up in a way that is reusable for yourself and other interaction designers.

Test-Driven Development

Test-driven development involves writing unit tests before code to validate functionality. Unit tests help manage changes by continuously validating code correctness and allowing code to be changed safely. While some myths exist around unit testing, it can save significant time compared to finding and fixing bugs later. Setting up projects with separate code and test folders allows tests to run independently.

An Opinionated Introduction to Mate

Diving Deep with the Flex Component Life Cycle

The document discusses the Flex component lifecycle, which consists of three main phases: birth, life, and death. The birth phase includes construction, configuration, attachment, and initialization. The life phase involves invalidation, validation, and interaction. Invalidation triggers the validation phase, which consists of commitProperties(), measure(), and updateDisplayList() methods. These methods apply deferred changes, measure component sizes, and update displays. The validation phase prepares components for rendering before the next frame.

Flex 360 Rules Engine