How to plan a hadoop cluster for testing and production environmentAnna Yen
Athemaster wants to share our experience to plan Hardware Spec, server initial and role deployment with new Hadoop Users. There are 2 testing environments and 3 production environments for case study.
How to plan a hadoop cluster for testing and production environmentAnna Yen
Athemaster wants to share our experience to plan Hardware Spec, server initial and role deployment with new Hadoop Users. There are 2 testing environments and 3 production environments for case study.
1) The history and evolution of workforce management (WFM) began with the origins of organized labor through guilds and unions, then progressed through the industrial age, Great Depression, world wars, and information age with advances in technology and management practices.
2) Early WFM focused on productivity and piecework, evolving to consider worker psychology and organizations behavior through studies like the Hawthorne Experiments.
3) The computer age from the 1950s onward drove automation and complexity of WFM systems, beginning with payroll and moving to integrated HR, scheduling, absence planning and workforce planning systems.
4) Future WFM will continue replacing systems regularly to optimize employee scheduling and drive down labor costs through breakthroughs like
Data can be stored in various places such as databases, XML files, and RAM. LINQ provides a standard syntax to work with data regardless of source through language integrated queries. It allows querying databases and in-memory collections using similar syntax. The document introduces LINQ to Objects, which works with in-memory objects, and LINQ to SQL, which allows querying database tables using object-oriented code. Key LINQ concepts like queries, filtering, projections and CRUD operations on databases are covered.
1) The history and evolution of workforce management (WFM) began with the origins of organized labor through guilds and unions, then progressed through the industrial age, Great Depression, world wars, and information age with advances in technology and management practices.
2) Early WFM focused on productivity and piecework, evolving to consider worker psychology and organizations behavior through studies like the Hawthorne Experiments.
3) The computer age from the 1950s onward drove automation and complexity of WFM systems, beginning with payroll and moving to integrated HR, scheduling, absence planning and workforce planning systems.
4) Future WFM will continue replacing systems regularly to optimize employee scheduling and drive down labor costs through breakthroughs like
Data can be stored in various places such as databases, XML files, and RAM. LINQ provides a standard syntax to work with data regardless of source through language integrated queries. It allows querying databases and in-memory collections using similar syntax. The document introduces LINQ to Objects, which works with in-memory objects, and LINQ to SQL, which allows querying database tables using object-oriented code. Key LINQ concepts like queries, filtering, projections and CRUD operations on databases are covered.
SQL Server Replication Transactional Replication from MSSQL 200x to MYSQL 5.xThet Aung Min Latt
This document discusses transactional replication from Microsoft SQL Server to MySQL 5.x. It provides an overview of the different types of SQL Server replication - snapshot, transactional, and merge replication. Transactional replication replicates data and schema changes in near real time from the SQL Server publication database to the MySQL subscriber. The document outlines the test environment used and steps to configure SQL Server as the publisher and MySQL as the subscriber, including allowing the MySQL user, installing the MySQL ODBC connector, adding the DSN, configuring the publication database in SQL Server Management Studio, and changing provider options.
Mysql is an open source relational database management system that can be downloaded for free from mysql.com. It allows users to define, construct, manipulate and access databases through SQL queries. The document provides an overview of mysql and databases, instructions for downloading and starting mysql, descriptions of basic SQL queries like SELECT, INSERT, UPDATE and DELETE, and examples of creating a sample employee table and running queries on it.
This document provides an overview and instructions for installing and using the MySQL database system. It describes MySQL's client-server architecture, how to connect to the MySQL server using the command line client, and provides examples of common SQL commands for creating databases and tables, inserting, selecting, updating, and deleting rows of data. It also introduces some basic SQL functions and provides SQL scripts as examples to create tables and insert data.
How to Make Awesome SlideShares: Tips & TricksSlideShare
Turbocharge your online presence with SlideShare. We provide the best tips and tricks for succeeding on SlideShare. Get ideas for what to upload, tips for designing your deck and more.
SlideShare is a global platform for sharing presentations, infographics, videos and documents. It has over 18 million pieces of professional content uploaded by experts like Eric Schmidt and Guy Kawasaki. The document provides tips for setting up an account on SlideShare, uploading content, optimizing it for searchability, and sharing it on social media to build an audience and reputation as a subject matter expert.
此簡報為 Will 保哥 於 2015/6/25 (四) 接受 SQL PASS Taiwan 邀請演講的內容。
現場錄影: http://www.microsoftvirtualacademy.com/training-courses/sql-server-realase-management?mtag=MVP4015686
[ Will 保哥的部落格 - The Will Will Web ]
http://blog.miniasp.com
[ Will 保哥的技術交流中心 ] (Facebook 粉絲專頁)
https://www.facebook.com/will.fans
[ Will 保哥的噗浪 ]
http://www.plurk.com/willh/invite
[ Will 保哥的推特 ]
https://twitter.com/Will_Huang
[ Will 保哥的 G+ 頁面 ]
http://gplus.to/willh
MySQL 5.7 includes several new features that improve performance, replication, and high availability. Key features include performance improvements from the performance schema and optimizer enhancements, replication improvements like multi-source replication and transaction-based parallel replication, and InnoDB improvements such as online operations and general tablespaces.
SQL Tuning02-Intorduction to the CBO OptimizerZhaoyang Wang
This document provides an introduction to the Cost-Based Oracle Optimizer (CBO). It describes the main components of the CBO including the estimator, plan generator, and OPTIMIZER_MODE. It also discusses important CBO concepts like selectivity, cardinality, cost and how they are estimated. The document provides examples of how to view CBO statistics and use 10053 tracing to analyze plans.
SQL Tuning04-Interpreting Execution PlansZhaoyang Wang
This document discusses various methods for interpreting SQL execution plans in Oracle databases, including using the PLAN_TABLE, views like V$SQL_PLAN, and tools like DBMS_XPLAN and AUTOTRACE. It also covers gathering plan statistics and interpretation from sources like the Automatic Workload Repository (AWR).
SQL Tuning01-Introduction to SQL TuningZhaoyang Wang
This document provides an introduction to SQL tuning. It discusses common causes of poor SQL performance such as stale statistics, missing indexes, and suboptimal execution plans. It then describes Oracle tools that can be used for SQL tuning such as the Automatic Database Diagnostic Monitor and SQL Tuning Advisor. Various SQL performance metrics are covered like wait time and how it relates to CPU and I/O times. Common SQL performance problems are also listed like parsing issues, full table scans, and redo log configuration errors. Finally, techniques for SQL tuning are discussed such as query rewrites, materialized views, and cursor sharing.
This document provides an overview of MySQL full-text search capabilities. It discusses the three types of full-text searches supported: natural language, boolean, and query expansion searches. It also covers stopwords, relevance ranking calculations, and techniques for fine-tuning full-text search performance such as configuring minimum/maximum word lengths and optimizing indexes. The document concludes with some restrictions and best practices for MySQL full-text search.
The document summarizes the key data structures used to organize data in InnoDB:
- InnoDB stores data in tablespaces which consist of data files. A tablespace header tracks free/used extents within these files.
- Data files contain fixed-size pages which are organized into extents of 1MB each. Page headers identify page types like interior, leaf, etc.
- File segments allocate ranges of pages to index trees. The root node of each index references two segment headers to allocate leaf/non-leaf pages separately.
MYSQLCLONE is a free and simple tool used to clone MySQL databases from one server to another. It can transfer the entire database including data, schemas, stored procedures, functions and events. The tool connects to the source and destination databases using connection parameters and then transfers the database objects and data in either LOAD or INSERT mode. Quick usage examples are provided to demonstrate transferring the full database, schema objects only, and row data in INSERT mode.
Oracle security 08-oracle network securityZhaoyang Wang
The document discusses securing Oracle Network services. It provides checklists and procedures for securing clients, the network, and the listener. It recommends configuring clients and browsers with authentication and encryption. It also recommends restricting network access through firewalls and IP address validation. For the listener, it suggests restricting privileges, password protecting administration, and monitoring logs to analyze activity and potential attacks. The goal is to describe how to securely administer the network and listener to restrict access and analyze logs for security.
Oracle security 02-administering user securityZhaoyang Wang
This document discusses administering user security in an Oracle database. It covers how to create and manage database user accounts, including authenticating users and assigning privileges. It also covers creating and managing roles to simplify privilege management, and creating profiles to implement password security and control resource usage. Profiles allow enforcing standards for password complexity, aging, locking accounts, and limiting resource consumption. The document stresses applying the principle of least privilege and separating administrative duties for security.
39. • MYSQLEXP is free, simple and efficient. It’s
used to export data from mysql database.
• You can execute a sql statement explicitly or
read it from sql file, yet you can flexibly specify
the field delimiter, and what field enclosed by.
MYSQLEXP-What is MYSQLEXP?
40. royalwzy@tools$ ./mysqlexp
mysqlexp Version 2.1.0.0, for OS X, by Wang Zhaoyang(royalwzy.com)
<sonne.k.wang@gmail.com>
This tool is used to export data through sql statement.
Usage: mysqlexp [OPTIONS] [database]
-?, --help Display this help and exit.
-I, --help Synonym for -?.
-h, --host=name Connect to host, [localhost] for default.
-u, --user=name User for login, [root] for defualt.
-p, --password=name Password to use when connecting to server, [] for
default.
-D, --database=name Database to use, [mysql] for default.
-P, --port=# Port number to use for connection, [3306] for default.
-S, --socket=name The socket file to use for connection.
-c, --charset-set=name The charset to use for connection, [utf8] for default.
-v, --verbose Write more information, [0] for default.
-V, --version Output version information and exit.
-H, --header Whether display header or not.
-d, --delimiter=symbol Field delimiter, [,] for default.
-E, --enclose=symbol What field enclose by.
-e, --sql=statement Sql statement to execute.
-s, --sqlfile=name The file to store sql statement, instead of reading
from command line.
-f, --dumpfile=name Write data to the dump file, [mysqlexp.csv] for
default.
-b, --feedback=nums How many rows to feedback, [500000] for default.
MYSQLEXP-How to use it?
42. MYSQLCLONE is free, simple and efficient.
It’s used to transfer a mysql database to the
other.
MYSQLCLONE-What is MYSQLCLONE?
43. royalwzy@tools$ ./mysqlclone
mysqlclone Version 1.2.0.0, for OS X, by Wang Zhaoyang(royalwzy.com)
<sonne.k.wang@gmail.com>
This tool is used to clone database.
Usage: mysqlclone [OPTIONS] [database]
-?, --help Display this help and exit.
-h, --help Synonym for -?.
--src-host=name Source connect to host.
--src-user=name Source user for login.
--src-password=name Source password to use when connecting to server.
--src-port=# Source port number to use for connection, [3306] for default.
--src-socket=name The source socket file to use for connection.
--src-db=name Source databases to clone, cann't be system databases.
--dst-host=name Destination connect to host.
--dst-user=name Destination user for login.
--dst-password=name Destination password to use when connecting to server.
--dst-port=# Destination port number to use for connection, [3306] for
default.
--dst-socket=name The destination socket file to use for connection.
--dst-db=name Database names are remapped to another database, cann't be system
databases.
--dst-bin-log Whether generate binlog or not , [false] for default.
-m, --mode Which mode to transfer data, can only be load or insert, [load]
for default.
-d, --drop-src-db Whether drop source database or not, [FALSE] for default.
-D, --no-data No row information, [FALSE] for default.
-E, --events Events included, [FALSE] for default.
-R, --routines functions and procedures included, [FALSE] for default.
-x, --lock-all-tables Locks all tables across all databases, [Lock the table to be
read] for default.
-v, --verbose Write more information, [0] for default.
-V, --version Output version information and exit.
MYSQLCLONE-How to use it?
44. MYSQLCLONE-Quick Examples!
1.LOAD mode:
royalwzy@tools$ ./mysqlclone --src-host=localhost --src-user=root --src-db=test --dst-host=localhost --dst-
user=root --dst-db=test1
2014-12-05 21:05:00 INFO: database test started to clone, and remapped to test1.
2014-12-05 21:05:00 INFO: - table [t1] was transferred, Records: 0 Deleted: 0 Skipped: 0 Warnings: 0
2014-12-05 21:05:00 INFO: - table [t2] was transferred, Records: 3 Deleted: 0 Skipped: 0 Warnings: 0
2.SCHEMA only:
royalwzy@tools$ ./mysqlclone --src-host=localhost --src-user=root --src-db=test --dst-host=localhost --dst-
user=root --dst-db=test1 -R -E -D
2014-12-05 21:06:08 INFO: database test started to clone, and remapped to test1.
2014-12-05 21:06:08 INFO: - table [t1] was transferred.
2014-12-05 21:06:08 INFO: - table [t2] was transferred.
2014-12-05 21:06:08 INFO: - procedure [pr_test] was transferred.
2014-12-05 21:06:08 INFO: - procedure [pr_time] was transferred.
2014-12-05 21:06:08 INFO: - function [fn_test] was transferred.
2014-12-05 21:06:08 INFO: - event [event_test] was transferred.
3.INSERT mode:
royalwzy@tools$ ./mysqlclone --src-host=localhost --src-user=root --src-db=test --dst-host=localhost --dst-
user=root --dst-db=test1 --mode=INSERT
2014-12-05 21:04:16 INFO: database test started to clone, and remapped to test1.
2014-12-05 21:04:16 INFO: - table [t1] was transferred, [0] row succeed and [0] row failed.
2014-12-05 21:04:16 INFO: - table [t2] was transferred, [3] rows succeed and [0] row failed.
