SlideShare a Scribd company logo
Linux Survival Skills
Bob Wakefield
Principal
bob@MassStreet.net
Twitter: @MassStreet
Who is Mass Street?
•Boutique data consultancy
•Hortonworks Partner
•Big data training
Bob’s Background
• IT professional 16 years
• Background is mostly Windows tech
• Education
• BS Business Admin (MIS) from KState
• MBA (finance concentration) from KU
• Coursework in Mathematics at Washburn
• Graduate certificate data science from Rockhurst
•Addicted to everything data
Administration
•The history of the group
•Day of the week will rotate
between Tues, Wed and Thurs
•Weekends for larger topics
•Location?
This evening’s objectives
•NOT to become masters of the
Linux OS
•Just be able to move around in
Linux
•Linux is the gateway drug to
big data
Where Can I Get More Info?
• Udemy!
•Linux for Beginners by Jason Cannon
•Whole series on Linux
•Stack Overflow (surprisingly)
Linux: A quick history
• Created by Linus Tovalds et al and
released to the wild in 1991. v1 released
in 1994.
•Not mini Unix!
•Linux 2002 = yuck
•Linux 2015 = pretty awesome
The Many Flavors of Linux
• There are many Linux distros and each one is a little (or a lot)
different.
• DistroWatch.com
• Popular Distros
• Ubuntu = Linux for the “home”
• Red Hat (RHEL) = Linux “pro”
• CentOS = Free RHEL
• Hadoop distros run on RHEL and CentOS (and Windows but
meh)
• Just say no to GUIs!
Getting Your VM Set Up
Package Managers
•Ubuntu = apt-git
•CentOS = yum
Let’s update and install some
software
•Yum update
•Yum install nano
Linux Shell Basics
•[user@server current directory] $|=
•$ = normal user
•= = super user
•Up and down arrows will show command
history
•No recycle bin! Changes are permanent.
Linux Shell Basics
•~ = this accounts home directory
•/ = root
Directory Structure
• / = “Root,” the top of the file system hierarchy.
• /bin = Binaries and other executable programs.
• /etc = System configuration files.
• /home = User Home directories (like Windows
documents)
• /opt = Optional or third party software.
• /tmp = Temporary space, typically cleared on reboot.
• /usr = User related programs.
• /var = Variable data, most notably log files.
Useful Linux Commands
• ls - Lists directory contents.
• cd - Changes the current directory.
• pwd - Displays the present working directory.
• man - Displays the online manual.
• exit/logout/ ctrl-d - Exits the shell or your current
session.
• clear - Clears the screen.
Useful Linux Commands
• ls - Lists directory contents.
• Ls – l – long listing
• cd - Changes the current directory.
• pwd - Displays the present working directory.
• man - Displays the online manual.
• exit/logout/ ctrl-d - Exits the shell or your current
session.
• clear - Clears the screen.
Navigation
• Cd (nothing) = go home
• CD . = this directory
• CD .. = parent directory
• CD - = previous directory
• CD /bob = change to the bob directory
File Operations
•Shhhh! I don’t use these.
•So why are we learning them?
•A lot of HDFS commands are the same as linux
commands
•You cannot interact with HDFS using WinSCP
or another FTP program
File Operations
• mkdir directory = Create a directory
• rm file = Remove (delete) file
• rm -r directory = Remove the directory and its contents
• recursively
• rm -f file = Force removal of file without prompting for
• confirmation
• rm -rf directory = Forcefully remove directory
recursively
• mv file1 file2 = Rename or move file1 to file2 . If file2 is
an existing directory, move file1 into directory file2
File Permissions
• Page 5 of cheat sheet
• Permissions
• R = read
• W = write
• X execute
• Permission Categories
• U = user that owns the file
• G = the users in that group
• O = other not the user and current user is not in group
File Permissions Decrypted
•rw-r--rwx
•User/Group/Other
•User has read write
•Group has read only
•Other has read write execute
Changing Permissions
•We’re going to learn the easy way.
•Covert symbolic to base 10
• Three categories UGO
• Three positions rwx
• rwx in binary = 111 (rw- = 110)
• 111 in base 10 = 7 (4 + 2 + 1) (110 = 6)
•rwxrwxrwx = 777 (don’t try this at home)
•Chmod 777 filename
Things We Didn’t Tackle
•Finding files
•Gzip (compression)
•Tar (archive)
•SCP (secure copy over network)
•Wget (download file from web)
•Sudo (act as a user)
•Ssh (connect securely to another machine)
On Your Own

More Related Content

What's hot

Filepermissions in linux
Filepermissions in linuxFilepermissions in linux
Filepermissions in linux
Subashini Pandiarajan
 
Unix files
Unix filesUnix files
Unix files
Sunil Rm
 
File permissions
File permissionsFile permissions
File permissions
Varnnit Jain
 
Lets talk dns
Lets talk dnsLets talk dns
Lets talk dns
Abhinav Mehta
 
06 users groups_and_permissions
06 users groups_and_permissions06 users groups_and_permissions
06 users groups_and_permissions
Shay Cohen
 
Zabi
ZabiZabi
Zabi
Zia Hotak
 
Nfs
NfsNfs
OECD policies & TERMINALFOUR as a policy for innovation:TERMINALFOUR t44u 2013
OECD policies & TERMINALFOUR as a policy for innovation:TERMINALFOUR t44u 2013OECD policies & TERMINALFOUR as a policy for innovation:TERMINALFOUR t44u 2013
OECD policies & TERMINALFOUR as a policy for innovation:TERMINALFOUR t44u 2013
Terminalfour
 
Sun NFS , Case study
Sun NFS , Case study Sun NFS , Case study
Sun NFS , Case study
Shashwat Singh
 
Nfs
NfsNfs
SUN Network File system - Design, Implementation and Experience
SUN Network File system - Design, Implementation and Experience SUN Network File system - Design, Implementation and Experience
SUN Network File system - Design, Implementation and Experience
aniadkar
 
Nfs
NfsNfs
Linux
LinuxLinux
Linux
ahmed sami
 
Network File System in Distributed Computing
Network File System in Distributed ComputingNetwork File System in Distributed Computing
Network File System in Distributed Computing
Chandan Padalkar
 
Nfs
NfsNfs
Introduction to linux
Introduction to linuxIntroduction to linux
Introduction to linux
nanocdac
 
OpenZFS - BSDcan 2014
OpenZFS - BSDcan 2014OpenZFS - BSDcan 2014
OpenZFS - BSDcan 2014
Matthew Ahrens
 
RIO Distribution: Reconstructing the onion - Shyamsundar Ranganathan
RIO Distribution: Reconstructing the onion - Shyamsundar RanganathanRIO Distribution: Reconstructing the onion - Shyamsundar Ranganathan
RIO Distribution: Reconstructing the onion - Shyamsundar Ranganathan
Gluster.org
 
NETWORK FILE SYSTEM
NETWORK FILE SYSTEMNETWORK FILE SYSTEM
NETWORK FILE SYSTEM
Roshan Kumar
 
Linux administration classes in mumbai
Linux administration classes in mumbaiLinux administration classes in mumbai
Linux administration classes in mumbai
Vibrant Technologies & Computers
 

What's hot (20)

Filepermissions in linux
Filepermissions in linuxFilepermissions in linux
Filepermissions in linux
 
Unix files
Unix filesUnix files
Unix files
 
File permissions
File permissionsFile permissions
File permissions
 
Lets talk dns
Lets talk dnsLets talk dns
Lets talk dns
 
06 users groups_and_permissions
06 users groups_and_permissions06 users groups_and_permissions
06 users groups_and_permissions
 
Zabi
ZabiZabi
Zabi
 
Nfs
NfsNfs
Nfs
 
OECD policies & TERMINALFOUR as a policy for innovation:TERMINALFOUR t44u 2013
OECD policies & TERMINALFOUR as a policy for innovation:TERMINALFOUR t44u 2013OECD policies & TERMINALFOUR as a policy for innovation:TERMINALFOUR t44u 2013
OECD policies & TERMINALFOUR as a policy for innovation:TERMINALFOUR t44u 2013
 
Sun NFS , Case study
Sun NFS , Case study Sun NFS , Case study
Sun NFS , Case study
 
Nfs
NfsNfs
Nfs
 
SUN Network File system - Design, Implementation and Experience
SUN Network File system - Design, Implementation and Experience SUN Network File system - Design, Implementation and Experience
SUN Network File system - Design, Implementation and Experience
 
Nfs
NfsNfs
Nfs
 
Linux
LinuxLinux
Linux
 
Network File System in Distributed Computing
Network File System in Distributed ComputingNetwork File System in Distributed Computing
Network File System in Distributed Computing
 
Nfs
NfsNfs
Nfs
 
Introduction to linux
Introduction to linuxIntroduction to linux
Introduction to linux
 
OpenZFS - BSDcan 2014
OpenZFS - BSDcan 2014OpenZFS - BSDcan 2014
OpenZFS - BSDcan 2014
 
RIO Distribution: Reconstructing the onion - Shyamsundar Ranganathan
RIO Distribution: Reconstructing the onion - Shyamsundar RanganathanRIO Distribution: Reconstructing the onion - Shyamsundar Ranganathan
RIO Distribution: Reconstructing the onion - Shyamsundar Ranganathan
 
NETWORK FILE SYSTEM
NETWORK FILE SYSTEMNETWORK FILE SYSTEM
NETWORK FILE SYSTEM
 
Linux administration classes in mumbai
Linux administration classes in mumbaiLinux administration classes in mumbai
Linux administration classes in mumbai
 

Similar to Hands On: Linux survival skills

Linuxtraining 130710022121-phpapp01
Linuxtraining 130710022121-phpapp01Linuxtraining 130710022121-phpapp01
Linuxtraining 130710022121-phpapp01
Chander Pandey
 
redhat_by_Cbitss.ppt
redhat_by_Cbitss.pptredhat_by_Cbitss.ppt
redhat_by_Cbitss.ppt
VikrantSChohaan
 
Unix Shell Script - 2 Days Session.pptx
Unix Shell Script - 2 Days Session.pptxUnix Shell Script - 2 Days Session.pptx
Unix Shell Script - 2 Days Session.pptx
Rajesh Kumar
 
LINUX_admin_commands.pptx
LINUX_admin_commands.pptxLINUX_admin_commands.pptx
LINUX_admin_commands.pptx
GuhanSenthil2
 
Linux: Basics OF Linux
Linux: Basics OF LinuxLinux: Basics OF Linux
Linux: Basics OF Linux
Omkar Walavalkar
 
ITCP PRACTICAL-1.pptx
ITCP PRACTICAL-1.pptxITCP PRACTICAL-1.pptx
ITCP PRACTICAL-1.pptx
HemantJadhao3
 
Linux operating system by Quontra Solutions
Linux operating system by Quontra SolutionsLinux operating system by Quontra Solutions
Linux operating system by Quontra Solutions
QUONTRASOLUTIONS
 
Operating Systems: Linux in Detail
Operating Systems: Linux in DetailOperating Systems: Linux in Detail
Operating Systems: Linux in Detail
Damian T. Gordon
 
UNIX/Linux training
UNIX/Linux trainingUNIX/Linux training
UNIX/Linux training
Michael Olafusi
 
Unix _linux_fundamentals_for_hpc-_b
Unix  _linux_fundamentals_for_hpc-_bUnix  _linux_fundamentals_for_hpc-_b
Unix _linux_fundamentals_for_hpc-_b
Mohammad Reza Beygi
 
PowerPoint_merge.ppt on unix programming
PowerPoint_merge.ppt on unix programmingPowerPoint_merge.ppt on unix programming
PowerPoint_merge.ppt on unix programming
Priyadarshini648418
 
Linux: Everyting-as-a-service
Linux: Everyting-as-a-serviceLinux: Everyting-as-a-service
Linux: Everyting-as-a-service
Rohit Sansiya
 
2. UNIX OS System Architecture easy.pptx
2. UNIX OS System Architecture easy.pptx2. UNIX OS System Architecture easy.pptx
2. UNIX OS System Architecture easy.pptx
Priyadarshini648418
 
How to Audit Linux - Gene Kartavtsev, ISACA MN
How to Audit Linux - Gene Kartavtsev, ISACA MNHow to Audit Linux - Gene Kartavtsev, ISACA MN
How to Audit Linux - Gene Kartavtsev, ISACA MN
Gene Kartavtsev
 
File system discovery
File system discovery File system discovery
File system discovery
DevMix
 
Unix/Linux
Unix/Linux Unix/Linux
Unix/Linux
Saurabh Upadhyay
 
KMSUnix and Linux.pptx
KMSUnix and Linux.pptxKMSUnix and Linux.pptx
KMSUnix and Linux.pptx
Ganesh Bhosale
 
001 linux revision
001 linux revision001 linux revision
001 linux revision
Sherif Mousa
 
Hpux graduate enginnering trainning
Hpux graduate enginnering trainningHpux graduate enginnering trainning
Hpux graduate enginnering trainning
Radhe Garg
 
Introduction to UNIX
Introduction to UNIXIntroduction to UNIX

Similar to Hands On: Linux survival skills (20)

Linuxtraining 130710022121-phpapp01
Linuxtraining 130710022121-phpapp01Linuxtraining 130710022121-phpapp01
Linuxtraining 130710022121-phpapp01
 
redhat_by_Cbitss.ppt
redhat_by_Cbitss.pptredhat_by_Cbitss.ppt
redhat_by_Cbitss.ppt
 
Unix Shell Script - 2 Days Session.pptx
Unix Shell Script - 2 Days Session.pptxUnix Shell Script - 2 Days Session.pptx
Unix Shell Script - 2 Days Session.pptx
 
LINUX_admin_commands.pptx
LINUX_admin_commands.pptxLINUX_admin_commands.pptx
LINUX_admin_commands.pptx
 
Linux: Basics OF Linux
Linux: Basics OF LinuxLinux: Basics OF Linux
Linux: Basics OF Linux
 
ITCP PRACTICAL-1.pptx
ITCP PRACTICAL-1.pptxITCP PRACTICAL-1.pptx
ITCP PRACTICAL-1.pptx
 
Linux operating system by Quontra Solutions
Linux operating system by Quontra SolutionsLinux operating system by Quontra Solutions
Linux operating system by Quontra Solutions
 
Operating Systems: Linux in Detail
Operating Systems: Linux in DetailOperating Systems: Linux in Detail
Operating Systems: Linux in Detail
 
UNIX/Linux training
UNIX/Linux trainingUNIX/Linux training
UNIX/Linux training
 
Unix _linux_fundamentals_for_hpc-_b
Unix  _linux_fundamentals_for_hpc-_bUnix  _linux_fundamentals_for_hpc-_b
Unix _linux_fundamentals_for_hpc-_b
 
PowerPoint_merge.ppt on unix programming
PowerPoint_merge.ppt on unix programmingPowerPoint_merge.ppt on unix programming
PowerPoint_merge.ppt on unix programming
 
Linux: Everyting-as-a-service
Linux: Everyting-as-a-serviceLinux: Everyting-as-a-service
Linux: Everyting-as-a-service
 
2. UNIX OS System Architecture easy.pptx
2. UNIX OS System Architecture easy.pptx2. UNIX OS System Architecture easy.pptx
2. UNIX OS System Architecture easy.pptx
 
How to Audit Linux - Gene Kartavtsev, ISACA MN
How to Audit Linux - Gene Kartavtsev, ISACA MNHow to Audit Linux - Gene Kartavtsev, ISACA MN
How to Audit Linux - Gene Kartavtsev, ISACA MN
 
File system discovery
File system discovery File system discovery
File system discovery
 
Unix/Linux
Unix/Linux Unix/Linux
Unix/Linux
 
KMSUnix and Linux.pptx
KMSUnix and Linux.pptxKMSUnix and Linux.pptx
KMSUnix and Linux.pptx
 
001 linux revision
001 linux revision001 linux revision
001 linux revision
 
Hpux graduate enginnering trainning
Hpux graduate enginnering trainningHpux graduate enginnering trainning
Hpux graduate enginnering trainning
 
Introduction to UNIX
Introduction to UNIXIntroduction to UNIX
Introduction to UNIX
 

More from Adaryl "Bob" Wakefield, MBA

The Marriage of the Data Lake and the Data Warehouse and Why You Need Both
The Marriage of the Data Lake and the Data Warehouse and Why You Need BothThe Marriage of the Data Lake and the Data Warehouse and Why You Need Both
The Marriage of the Data Lake and the Data Warehouse and Why You Need Both
Adaryl "Bob" Wakefield, MBA
 
Big Data Technologies and Why They Matter To R Users
Big Data Technologies and Why They Matter To R UsersBig Data Technologies and Why They Matter To R Users
Big Data Technologies and Why They Matter To R Users
Adaryl "Bob" Wakefield, MBA
 
Getting Started With Sparklyr
Getting Started With SparklyrGetting Started With Sparklyr
Getting Started With Sparklyr
Adaryl "Bob" Wakefield, MBA
 
Perfecting Your Streaming Skills with Spark and Real World IoT Data
Perfecting Your Streaming Skills with Spark and Real World IoT DataPerfecting Your Streaming Skills with Spark and Real World IoT Data
Perfecting Your Streaming Skills with Spark and Real World IoT Data
Adaryl "Bob" Wakefield, MBA
 
Reproducible Research with R, The Tidyverse, Notebooks, and Spark
Reproducible Research with R, The Tidyverse, Notebooks, and SparkReproducible Research with R, The Tidyverse, Notebooks, and Spark
Reproducible Research with R, The Tidyverse, Notebooks, and Spark
Adaryl "Bob" Wakefield, MBA
 
Architecting Your First Big Data Implementation
Architecting Your First Big Data ImplementationArchitecting Your First Big Data Implementation
Architecting Your First Big Data Implementation
Adaryl "Bob" Wakefield, MBA
 
Hands On: Introduction to the Hadoop Ecosystem
Hands On: Introduction to the Hadoop EcosystemHands On: Introduction to the Hadoop Ecosystem
Hands On: Introduction to the Hadoop Ecosystem
Adaryl "Bob" Wakefield, MBA
 
In Memory Databases: A Real Time Analytics Solution
In Memory Databases: A Real Time Analytics SolutionIn Memory Databases: A Real Time Analytics Solution
In Memory Databases: A Real Time Analytics Solution
Adaryl "Bob" Wakefield, MBA
 
Not Just Another Overview of Apache Hadoop
Not Just Another Overview of Apache HadoopNot Just Another Overview of Apache Hadoop
Not Just Another Overview of Apache Hadoop
Adaryl "Bob" Wakefield, MBA
 

More from Adaryl "Bob" Wakefield, MBA (9)

The Marriage of the Data Lake and the Data Warehouse and Why You Need Both
The Marriage of the Data Lake and the Data Warehouse and Why You Need BothThe Marriage of the Data Lake and the Data Warehouse and Why You Need Both
The Marriage of the Data Lake and the Data Warehouse and Why You Need Both
 
Big Data Technologies and Why They Matter To R Users
Big Data Technologies and Why They Matter To R UsersBig Data Technologies and Why They Matter To R Users
Big Data Technologies and Why They Matter To R Users
 
Getting Started With Sparklyr
Getting Started With SparklyrGetting Started With Sparklyr
Getting Started With Sparklyr
 
Perfecting Your Streaming Skills with Spark and Real World IoT Data
Perfecting Your Streaming Skills with Spark and Real World IoT DataPerfecting Your Streaming Skills with Spark and Real World IoT Data
Perfecting Your Streaming Skills with Spark and Real World IoT Data
 
Reproducible Research with R, The Tidyverse, Notebooks, and Spark
Reproducible Research with R, The Tidyverse, Notebooks, and SparkReproducible Research with R, The Tidyverse, Notebooks, and Spark
Reproducible Research with R, The Tidyverse, Notebooks, and Spark
 
Architecting Your First Big Data Implementation
Architecting Your First Big Data ImplementationArchitecting Your First Big Data Implementation
Architecting Your First Big Data Implementation
 
Hands On: Introduction to the Hadoop Ecosystem
Hands On: Introduction to the Hadoop EcosystemHands On: Introduction to the Hadoop Ecosystem
Hands On: Introduction to the Hadoop Ecosystem
 
In Memory Databases: A Real Time Analytics Solution
In Memory Databases: A Real Time Analytics SolutionIn Memory Databases: A Real Time Analytics Solution
In Memory Databases: A Real Time Analytics Solution
 
Not Just Another Overview of Apache Hadoop
Not Just Another Overview of Apache HadoopNot Just Another Overview of Apache Hadoop
Not Just Another Overview of Apache Hadoop
 

Recently uploaded

Software Test Automation - A Comprehensive Guide on Automated Testing.pdf
Software Test Automation - A Comprehensive Guide on Automated Testing.pdfSoftware Test Automation - A Comprehensive Guide on Automated Testing.pdf
Software Test Automation - A Comprehensive Guide on Automated Testing.pdf
kalichargn70th171
 
Cost-Effective Strategies For iOS App Development
Cost-Effective Strategies For iOS App DevelopmentCost-Effective Strategies For iOS App Development
Cost-Effective Strategies For iOS App Development
Softradix Technologies
 
一比一原版(USF毕业证)旧金山大学毕业证如何办理
一比一原版(USF毕业证)旧金山大学毕业证如何办理一比一原版(USF毕业证)旧金山大学毕业证如何办理
一比一原版(USF毕业证)旧金山大学毕业证如何办理
dakas1
 
Unlock the Secrets to Effortless Video Creation with Invideo: Your Ultimate G...
Unlock the Secrets to Effortless Video Creation with Invideo: Your Ultimate G...Unlock the Secrets to Effortless Video Creation with Invideo: Your Ultimate G...
Unlock the Secrets to Effortless Video Creation with Invideo: Your Ultimate G...
The Third Creative Media
 
Migration From CH 1.0 to CH 2.0 and Mule 4.6 & Java 17 Upgrade.pptx
Migration From CH 1.0 to CH 2.0 and  Mule 4.6 & Java 17 Upgrade.pptxMigration From CH 1.0 to CH 2.0 and  Mule 4.6 & Java 17 Upgrade.pptx
Migration From CH 1.0 to CH 2.0 and Mule 4.6 & Java 17 Upgrade.pptx
ervikas4
 
Upturn India Technologies - Web development company in Nashik
Upturn India Technologies - Web development company in NashikUpturn India Technologies - Web development company in Nashik
Upturn India Technologies - Web development company in Nashik
Upturn India Technologies
 
美洲杯赔率投注网【​网址​🎉3977·EE​🎉】
美洲杯赔率投注网【​网址​🎉3977·EE​🎉】美洲杯赔率投注网【​网址​🎉3977·EE​🎉】
美洲杯赔率投注网【​网址​🎉3977·EE​🎉】
widenerjobeyrl638
 
一比一原版(UMN毕业证)明尼苏达大学毕业证如何办理
一比一原版(UMN毕业证)明尼苏达大学毕业证如何办理一比一原版(UMN毕业证)明尼苏达大学毕业证如何办理
一比一原版(UMN毕业证)明尼苏达大学毕业证如何办理
dakas1
 
🏎️Tech Transformation: DevOps Insights from the Experts 👩‍💻
🏎️Tech Transformation: DevOps Insights from the Experts 👩‍💻🏎️Tech Transformation: DevOps Insights from the Experts 👩‍💻
🏎️Tech Transformation: DevOps Insights from the Experts 👩‍💻
campbellclarkson
 
DECODING JAVA THREAD DUMPS: MASTER THE ART OF ANALYSIS
DECODING JAVA THREAD DUMPS: MASTER THE ART OF ANALYSISDECODING JAVA THREAD DUMPS: MASTER THE ART OF ANALYSIS
DECODING JAVA THREAD DUMPS: MASTER THE ART OF ANALYSIS
Tier1 app
 
Secure-by-Design Using Hardware and Software Protection for FDA Compliance
Secure-by-Design Using Hardware and Software Protection for FDA ComplianceSecure-by-Design Using Hardware and Software Protection for FDA Compliance
Secure-by-Design Using Hardware and Software Protection for FDA Compliance
ICS
 
Microsoft-Power-Platform-Adoption-Planning.pptx
Microsoft-Power-Platform-Adoption-Planning.pptxMicrosoft-Power-Platform-Adoption-Planning.pptx
Microsoft-Power-Platform-Adoption-Planning.pptx
jrodriguezq3110
 
Orca: Nocode Graphical Editor for Container Orchestration
Orca: Nocode Graphical Editor for Container OrchestrationOrca: Nocode Graphical Editor for Container Orchestration
Orca: Nocode Graphical Editor for Container Orchestration
Pedro J. Molina
 
The Power of Visual Regression Testing_ Why It Is Critical for Enterprise App...
The Power of Visual Regression Testing_ Why It Is Critical for Enterprise App...The Power of Visual Regression Testing_ Why It Is Critical for Enterprise App...
The Power of Visual Regression Testing_ Why It Is Critical for Enterprise App...
kalichargn70th171
 
Transforming Product Development using OnePlan To Boost Efficiency and Innova...
Transforming Product Development using OnePlan To Boost Efficiency and Innova...Transforming Product Development using OnePlan To Boost Efficiency and Innova...
Transforming Product Development using OnePlan To Boost Efficiency and Innova...
OnePlan Solutions
 
Beginner's Guide to Observability@Devoxx PL 2024
Beginner's  Guide to Observability@Devoxx PL 2024Beginner's  Guide to Observability@Devoxx PL 2024
Beginner's Guide to Observability@Devoxx PL 2024
michniczscribd
 
Modelling Up - DDDEurope 2024 - Amsterdam
Modelling Up - DDDEurope 2024 - AmsterdamModelling Up - DDDEurope 2024 - Amsterdam
Modelling Up - DDDEurope 2024 - Amsterdam
Alberto Brandolini
 
What is Continuous Testing in DevOps - A Definitive Guide.pdf
What is Continuous Testing in DevOps - A Definitive Guide.pdfWhat is Continuous Testing in DevOps - A Definitive Guide.pdf
What is Continuous Testing in DevOps - A Definitive Guide.pdf
kalichargn70th171
 
Baha Majid WCA4Z IBM Z Customer Council Boston June 2024.pdf
Baha Majid WCA4Z IBM Z Customer Council Boston June 2024.pdfBaha Majid WCA4Z IBM Z Customer Council Boston June 2024.pdf
Baha Majid WCA4Z IBM Z Customer Council Boston June 2024.pdf
Baha Majid
 
Superpower Your Apache Kafka Applications Development with Complementary Open...
Superpower Your Apache Kafka Applications Development with Complementary Open...Superpower Your Apache Kafka Applications Development with Complementary Open...
Superpower Your Apache Kafka Applications Development with Complementary Open...
Paul Brebner
 

Recently uploaded (20)

Software Test Automation - A Comprehensive Guide on Automated Testing.pdf
Software Test Automation - A Comprehensive Guide on Automated Testing.pdfSoftware Test Automation - A Comprehensive Guide on Automated Testing.pdf
Software Test Automation - A Comprehensive Guide on Automated Testing.pdf
 
Cost-Effective Strategies For iOS App Development
Cost-Effective Strategies For iOS App DevelopmentCost-Effective Strategies For iOS App Development
Cost-Effective Strategies For iOS App Development
 
一比一原版(USF毕业证)旧金山大学毕业证如何办理
一比一原版(USF毕业证)旧金山大学毕业证如何办理一比一原版(USF毕业证)旧金山大学毕业证如何办理
一比一原版(USF毕业证)旧金山大学毕业证如何办理
 
Unlock the Secrets to Effortless Video Creation with Invideo: Your Ultimate G...
Unlock the Secrets to Effortless Video Creation with Invideo: Your Ultimate G...Unlock the Secrets to Effortless Video Creation with Invideo: Your Ultimate G...
Unlock the Secrets to Effortless Video Creation with Invideo: Your Ultimate G...
 
Migration From CH 1.0 to CH 2.0 and Mule 4.6 & Java 17 Upgrade.pptx
Migration From CH 1.0 to CH 2.0 and  Mule 4.6 & Java 17 Upgrade.pptxMigration From CH 1.0 to CH 2.0 and  Mule 4.6 & Java 17 Upgrade.pptx
Migration From CH 1.0 to CH 2.0 and Mule 4.6 & Java 17 Upgrade.pptx
 
Upturn India Technologies - Web development company in Nashik
Upturn India Technologies - Web development company in NashikUpturn India Technologies - Web development company in Nashik
Upturn India Technologies - Web development company in Nashik
 
美洲杯赔率投注网【​网址​🎉3977·EE​🎉】
美洲杯赔率投注网【​网址​🎉3977·EE​🎉】美洲杯赔率投注网【​网址​🎉3977·EE​🎉】
美洲杯赔率投注网【​网址​🎉3977·EE​🎉】
 
一比一原版(UMN毕业证)明尼苏达大学毕业证如何办理
一比一原版(UMN毕业证)明尼苏达大学毕业证如何办理一比一原版(UMN毕业证)明尼苏达大学毕业证如何办理
一比一原版(UMN毕业证)明尼苏达大学毕业证如何办理
 
🏎️Tech Transformation: DevOps Insights from the Experts 👩‍💻
🏎️Tech Transformation: DevOps Insights from the Experts 👩‍💻🏎️Tech Transformation: DevOps Insights from the Experts 👩‍💻
🏎️Tech Transformation: DevOps Insights from the Experts 👩‍💻
 
DECODING JAVA THREAD DUMPS: MASTER THE ART OF ANALYSIS
DECODING JAVA THREAD DUMPS: MASTER THE ART OF ANALYSISDECODING JAVA THREAD DUMPS: MASTER THE ART OF ANALYSIS
DECODING JAVA THREAD DUMPS: MASTER THE ART OF ANALYSIS
 
Secure-by-Design Using Hardware and Software Protection for FDA Compliance
Secure-by-Design Using Hardware and Software Protection for FDA ComplianceSecure-by-Design Using Hardware and Software Protection for FDA Compliance
Secure-by-Design Using Hardware and Software Protection for FDA Compliance
 
Microsoft-Power-Platform-Adoption-Planning.pptx
Microsoft-Power-Platform-Adoption-Planning.pptxMicrosoft-Power-Platform-Adoption-Planning.pptx
Microsoft-Power-Platform-Adoption-Planning.pptx
 
Orca: Nocode Graphical Editor for Container Orchestration
Orca: Nocode Graphical Editor for Container OrchestrationOrca: Nocode Graphical Editor for Container Orchestration
Orca: Nocode Graphical Editor for Container Orchestration
 
The Power of Visual Regression Testing_ Why It Is Critical for Enterprise App...
The Power of Visual Regression Testing_ Why It Is Critical for Enterprise App...The Power of Visual Regression Testing_ Why It Is Critical for Enterprise App...
The Power of Visual Regression Testing_ Why It Is Critical for Enterprise App...
 
Transforming Product Development using OnePlan To Boost Efficiency and Innova...
Transforming Product Development using OnePlan To Boost Efficiency and Innova...Transforming Product Development using OnePlan To Boost Efficiency and Innova...
Transforming Product Development using OnePlan To Boost Efficiency and Innova...
 
Beginner's Guide to Observability@Devoxx PL 2024
Beginner's  Guide to Observability@Devoxx PL 2024Beginner's  Guide to Observability@Devoxx PL 2024
Beginner's Guide to Observability@Devoxx PL 2024
 
Modelling Up - DDDEurope 2024 - Amsterdam
Modelling Up - DDDEurope 2024 - AmsterdamModelling Up - DDDEurope 2024 - Amsterdam
Modelling Up - DDDEurope 2024 - Amsterdam
 
What is Continuous Testing in DevOps - A Definitive Guide.pdf
What is Continuous Testing in DevOps - A Definitive Guide.pdfWhat is Continuous Testing in DevOps - A Definitive Guide.pdf
What is Continuous Testing in DevOps - A Definitive Guide.pdf
 
Baha Majid WCA4Z IBM Z Customer Council Boston June 2024.pdf
Baha Majid WCA4Z IBM Z Customer Council Boston June 2024.pdfBaha Majid WCA4Z IBM Z Customer Council Boston June 2024.pdf
Baha Majid WCA4Z IBM Z Customer Council Boston June 2024.pdf
 
Superpower Your Apache Kafka Applications Development with Complementary Open...
Superpower Your Apache Kafka Applications Development with Complementary Open...Superpower Your Apache Kafka Applications Development with Complementary Open...
Superpower Your Apache Kafka Applications Development with Complementary Open...
 

Hands On: Linux survival skills

  • 1. Linux Survival Skills Bob Wakefield Principal bob@MassStreet.net Twitter: @MassStreet
  • 2. Who is Mass Street? •Boutique data consultancy •Hortonworks Partner •Big data training
  • 3. Bob’s Background • IT professional 16 years • Background is mostly Windows tech • Education • BS Business Admin (MIS) from KState • MBA (finance concentration) from KU • Coursework in Mathematics at Washburn • Graduate certificate data science from Rockhurst •Addicted to everything data
  • 4. Administration •The history of the group •Day of the week will rotate between Tues, Wed and Thurs •Weekends for larger topics •Location?
  • 5. This evening’s objectives •NOT to become masters of the Linux OS •Just be able to move around in Linux •Linux is the gateway drug to big data
  • 6. Where Can I Get More Info? • Udemy! •Linux for Beginners by Jason Cannon •Whole series on Linux •Stack Overflow (surprisingly)
  • 7. Linux: A quick history • Created by Linus Tovalds et al and released to the wild in 1991. v1 released in 1994. •Not mini Unix! •Linux 2002 = yuck •Linux 2015 = pretty awesome
  • 8. The Many Flavors of Linux • There are many Linux distros and each one is a little (or a lot) different. • DistroWatch.com • Popular Distros • Ubuntu = Linux for the “home” • Red Hat (RHEL) = Linux “pro” • CentOS = Free RHEL • Hadoop distros run on RHEL and CentOS (and Windows but meh) • Just say no to GUIs!
  • 10. Package Managers •Ubuntu = apt-git •CentOS = yum
  • 11. Let’s update and install some software •Yum update •Yum install nano
  • 12. Linux Shell Basics •[user@server current directory] $|= •$ = normal user •= = super user •Up and down arrows will show command history •No recycle bin! Changes are permanent.
  • 13. Linux Shell Basics •~ = this accounts home directory •/ = root
  • 14. Directory Structure • / = “Root,” the top of the file system hierarchy. • /bin = Binaries and other executable programs. • /etc = System configuration files. • /home = User Home directories (like Windows documents) • /opt = Optional or third party software. • /tmp = Temporary space, typically cleared on reboot. • /usr = User related programs. • /var = Variable data, most notably log files.
  • 15. Useful Linux Commands • ls - Lists directory contents. • cd - Changes the current directory. • pwd - Displays the present working directory. • man - Displays the online manual. • exit/logout/ ctrl-d - Exits the shell or your current session. • clear - Clears the screen.
  • 16. Useful Linux Commands • ls - Lists directory contents. • Ls – l – long listing • cd - Changes the current directory. • pwd - Displays the present working directory. • man - Displays the online manual. • exit/logout/ ctrl-d - Exits the shell or your current session. • clear - Clears the screen.
  • 17. Navigation • Cd (nothing) = go home • CD . = this directory • CD .. = parent directory • CD - = previous directory • CD /bob = change to the bob directory
  • 18. File Operations •Shhhh! I don’t use these. •So why are we learning them? •A lot of HDFS commands are the same as linux commands •You cannot interact with HDFS using WinSCP or another FTP program
  • 19. File Operations • mkdir directory = Create a directory • rm file = Remove (delete) file • rm -r directory = Remove the directory and its contents • recursively • rm -f file = Force removal of file without prompting for • confirmation • rm -rf directory = Forcefully remove directory recursively • mv file1 file2 = Rename or move file1 to file2 . If file2 is an existing directory, move file1 into directory file2
  • 20. File Permissions • Page 5 of cheat sheet • Permissions • R = read • W = write • X execute • Permission Categories • U = user that owns the file • G = the users in that group • O = other not the user and current user is not in group
  • 21. File Permissions Decrypted •rw-r--rwx •User/Group/Other •User has read write •Group has read only •Other has read write execute
  • 22. Changing Permissions •We’re going to learn the easy way. •Covert symbolic to base 10 • Three categories UGO • Three positions rwx • rwx in binary = 111 (rw- = 110) • 111 in base 10 = 7 (4 + 2 + 1) (110 = 6) •rwxrwxrwx = 777 (don’t try this at home) •Chmod 777 filename
  • 23. Things We Didn’t Tackle •Finding files •Gzip (compression) •Tar (archive) •SCP (secure copy over network) •Wget (download file from web) •Sudo (act as a user) •Ssh (connect securely to another machine)