SlideShare a Scribd company logo
1 of 9
Download to read offline
Essentials of Linux Systems
Administration for Bioinformatics
José Héctor Gálvez
MonBUG
March 29, 2017
Identifying your role and responsibilities are the
first steps when interacting with a new system
Regular User
System
Administrator
Security ü ü
Backups ü ü
Troubleshooting ü ü
Software installation Þ ü
User management û ü
System updates û ü
You might be the
de facto system
administrator of
your lab’s
workstation!
Security should be the No. 1 concern of both
users and system administrators
Physical access
Local users
Remote access
No system is 100%
secure
• The human factor is the
weakest link
• Having a security policy will
help prevent exploits
• passwd
• chmod
Linux Security Modules:
• selinux
In bioinformatics and scientific computing
regular backups are especially important
Raw data üüü
User files (/home) üü
System configuration files üü
Log files ü
Software Þ
/tmp û
Pseudo-filesystems/swap û
• rsync
• tar,dd,dump,restore
• RAID arrays (fdisk)
What to back up? Treat data as read-only:
• Only allow programs to read
data and create new, separate
files of results
• Always make back-ups
All users should know the basics of troubleshooting
and ask for assistance when necessary
1. Characterize the problem
2. Reproduce the problem
3. Always try easy things first
4. Eliminate possible causes,
one at a time
5. Check system logs
• /var/log/messages
• /var/log/secure
• kill, killall,
pkill
• nice,unice
• ps,top,iostat
Keep a checklist
For example:
• Check exit status
• Check man pages
• Check file permissions…
Bioinformatics requires the use of custom software,
so having an installation policy is a good idea
• yum,APT
• make
• git clone
• Package managers offer advantages
• Automation
• Scalability
• Repeatability
• Security
• Auditing
• Other online repositories (github,
bitbucket) can provide similar
advantages
Systems with several users require constant
monitoring and limited permissions
• For regular users, consider:
• Expiry dates
• Memory quota/limited priority
• Periodic password changes
• Lock or disable inactive accounts
• Create user groups to manage
several users at once
• Use the root account (or sudo)
only when absolutely necessary
• useradd,groupadd
• usermod,groupmod
• passwd,chage
• chmod,chown
Never edit these
files directly!
• /etc/passwd
• /etc/group
• /etc/shadow
An out-of-date system is less secure and might
run slower than one that is regularly updated
• Regular schedule for updates
• Never skip security updates
• Package Management Systems:
• Regular updates
• “Smart-upgrade”
• Verify package integrity
• Remove packages
• Clean cache
• APT,yum
• RPM,DPKG
A well-administered system is key for system
reliability and research reproducibility
Further resources:

More Related Content

Similar to Essentials of Linux Systems Administration for Bioinformatics

operatinndnd jdj jjrg-system-1(1) (1).pptx
operatinndnd jdj jjrg-system-1(1) (1).pptxoperatinndnd jdj jjrg-system-1(1) (1).pptx
operatinndnd jdj jjrg-system-1(1) (1).pptx
krishnajoshi70
 

Similar to Essentials of Linux Systems Administration for Bioinformatics (20)

Unit 2.pptx
Unit 2.pptxUnit 2.pptx
Unit 2.pptx
 
Unit 2.pptx
Unit 2.pptxUnit 2.pptx
Unit 2.pptx
 
Operating Systems & Applications
Operating Systems & ApplicationsOperating Systems & Applications
Operating Systems & Applications
 
System Software AS Past paper question solution.pptx
System Software AS Past paper question solution.pptxSystem Software AS Past paper question solution.pptx
System Software AS Past paper question solution.pptx
 
Operating systems (For CBSE School Students)
Operating systems (For CBSE School Students)Operating systems (For CBSE School Students)
Operating systems (For CBSE School Students)
 
Operating System Introduction
Operating System IntroductionOperating System Introduction
Operating System Introduction
 
Introduction to Computer Software
Introduction to Computer SoftwareIntroduction to Computer Software
Introduction to Computer Software
 
operating system calls input and output by (rohit malav)
operating system calls input and output by (rohit malav)operating system calls input and output by (rohit malav)
operating system calls input and output by (rohit malav)
 
File Management & Access Control
File Management & Access Control File Management & Access Control
File Management & Access Control
 
Useful Shareware for Technical Communicators - STC New England Interchange co...
Useful Shareware for Technical Communicators - STC New England Interchange co...Useful Shareware for Technical Communicators - STC New England Interchange co...
Useful Shareware for Technical Communicators - STC New England Interchange co...
 
CNIT 121: 12 Investigating Windows Systems (Part 2 of 3)
CNIT 121: 12 Investigating Windows Systems (Part 2 of 3)CNIT 121: 12 Investigating Windows Systems (Part 2 of 3)
CNIT 121: 12 Investigating Windows Systems (Part 2 of 3)
 
8
88
8
 
Resource Monitoring and management
Resource Monitoring and management  Resource Monitoring and management
Resource Monitoring and management
 
Syslog.ppt
Syslog.pptSyslog.ppt
Syslog.ppt
 
1 5 system software and computer management
1 5 system software and computer management1 5 system software and computer management
1 5 system software and computer management
 
CNIT 152: 12b Windows Registry
CNIT 152: 12b Windows RegistryCNIT 152: 12b Windows Registry
CNIT 152: 12b Windows Registry
 
10 Tips for AIX Security
10 Tips for AIX Security10 Tips for AIX Security
10 Tips for AIX Security
 
Linux
Linux Linux
Linux
 
operatinndnd jdj jjrg-system-1(1) (1).pptx
operatinndnd jdj jjrg-system-1(1) (1).pptxoperatinndnd jdj jjrg-system-1(1) (1).pptx
operatinndnd jdj jjrg-system-1(1) (1).pptx
 
unit 2 confinement techniques.pdf
unit 2 confinement techniques.pdfunit 2 confinement techniques.pdf
unit 2 confinement techniques.pdf
 

Recently uploaded

COMPOSTING : types of compost, merits and demerits
COMPOSTING : types of compost, merits and demeritsCOMPOSTING : types of compost, merits and demerits
COMPOSTING : types of compost, merits and demerits
Cherry
 
Lipids: types, structure and important functions.
Lipids: types, structure and important functions.Lipids: types, structure and important functions.
Lipids: types, structure and important functions.
Cherry
 
Cyathodium bryophyte: morphology, anatomy, reproduction etc.
Cyathodium bryophyte: morphology, anatomy, reproduction etc.Cyathodium bryophyte: morphology, anatomy, reproduction etc.
Cyathodium bryophyte: morphology, anatomy, reproduction etc.
Cherry
 
Human genetics..........................pptx
Human genetics..........................pptxHuman genetics..........................pptx
Human genetics..........................pptx
Cherry
 
(May 9, 2024) Enhanced Ultrafast Vector Flow Imaging (VFI) Using Multi-Angle ...
(May 9, 2024) Enhanced Ultrafast Vector Flow Imaging (VFI) Using Multi-Angle ...(May 9, 2024) Enhanced Ultrafast Vector Flow Imaging (VFI) Using Multi-Angle ...
(May 9, 2024) Enhanced Ultrafast Vector Flow Imaging (VFI) Using Multi-Angle ...
Scintica Instrumentation
 
Module for Grade 9 for Asynchronous/Distance learning
Module for Grade 9 for Asynchronous/Distance learningModule for Grade 9 for Asynchronous/Distance learning
Module for Grade 9 for Asynchronous/Distance learning
levieagacer
 
Reboulia: features, anatomy, morphology etc.
Reboulia: features, anatomy, morphology etc.Reboulia: features, anatomy, morphology etc.
Reboulia: features, anatomy, morphology etc.
Cherry
 
The Mariana Trench remarkable geological features on Earth.pptx
The Mariana Trench remarkable geological features on Earth.pptxThe Mariana Trench remarkable geological features on Earth.pptx
The Mariana Trench remarkable geological features on Earth.pptx
seri bangash
 
Porella : features, morphology, anatomy, reproduction etc.
Porella : features, morphology, anatomy, reproduction etc.Porella : features, morphology, anatomy, reproduction etc.
Porella : features, morphology, anatomy, reproduction etc.
Cherry
 

Recently uploaded (20)

COMPOSTING : types of compost, merits and demerits
COMPOSTING : types of compost, merits and demeritsCOMPOSTING : types of compost, merits and demerits
COMPOSTING : types of compost, merits and demerits
 
Daily Lesson Log in Science 9 Fourth Quarter Physics
Daily Lesson Log in Science 9 Fourth Quarter PhysicsDaily Lesson Log in Science 9 Fourth Quarter Physics
Daily Lesson Log in Science 9 Fourth Quarter Physics
 
GBSN - Microbiology (Unit 4) Concept of Asepsis
GBSN - Microbiology (Unit 4) Concept of AsepsisGBSN - Microbiology (Unit 4) Concept of Asepsis
GBSN - Microbiology (Unit 4) Concept of Asepsis
 
Lipids: types, structure and important functions.
Lipids: types, structure and important functions.Lipids: types, structure and important functions.
Lipids: types, structure and important functions.
 
CURRENT SCENARIO OF POULTRY PRODUCTION IN INDIA
CURRENT SCENARIO OF POULTRY PRODUCTION IN INDIACURRENT SCENARIO OF POULTRY PRODUCTION IN INDIA
CURRENT SCENARIO OF POULTRY PRODUCTION IN INDIA
 
Cyathodium bryophyte: morphology, anatomy, reproduction etc.
Cyathodium bryophyte: morphology, anatomy, reproduction etc.Cyathodium bryophyte: morphology, anatomy, reproduction etc.
Cyathodium bryophyte: morphology, anatomy, reproduction etc.
 
Taphonomy and Quality of the Fossil Record
Taphonomy and Quality of the  Fossil RecordTaphonomy and Quality of the  Fossil Record
Taphonomy and Quality of the Fossil Record
 
GBSN - Biochemistry (Unit 2) Basic concept of organic chemistry
GBSN - Biochemistry (Unit 2) Basic concept of organic chemistry GBSN - Biochemistry (Unit 2) Basic concept of organic chemistry
GBSN - Biochemistry (Unit 2) Basic concept of organic chemistry
 
Understanding Partial Differential Equations: Types and Solution Methods
Understanding Partial Differential Equations: Types and Solution MethodsUnderstanding Partial Differential Equations: Types and Solution Methods
Understanding Partial Differential Equations: Types and Solution Methods
 
Genome Projects : Human, Rice,Wheat,E coli and Arabidopsis.
Genome Projects : Human, Rice,Wheat,E coli and Arabidopsis.Genome Projects : Human, Rice,Wheat,E coli and Arabidopsis.
Genome Projects : Human, Rice,Wheat,E coli and Arabidopsis.
 
Human genetics..........................pptx
Human genetics..........................pptxHuman genetics..........................pptx
Human genetics..........................pptx
 
FAIRSpectra - Enabling the FAIRification of Spectroscopy and Spectrometry
FAIRSpectra - Enabling the FAIRification of Spectroscopy and SpectrometryFAIRSpectra - Enabling the FAIRification of Spectroscopy and Spectrometry
FAIRSpectra - Enabling the FAIRification of Spectroscopy and Spectrometry
 
(May 9, 2024) Enhanced Ultrafast Vector Flow Imaging (VFI) Using Multi-Angle ...
(May 9, 2024) Enhanced Ultrafast Vector Flow Imaging (VFI) Using Multi-Angle ...(May 9, 2024) Enhanced Ultrafast Vector Flow Imaging (VFI) Using Multi-Angle ...
(May 9, 2024) Enhanced Ultrafast Vector Flow Imaging (VFI) Using Multi-Angle ...
 
Module for Grade 9 for Asynchronous/Distance learning
Module for Grade 9 for Asynchronous/Distance learningModule for Grade 9 for Asynchronous/Distance learning
Module for Grade 9 for Asynchronous/Distance learning
 
Reboulia: features, anatomy, morphology etc.
Reboulia: features, anatomy, morphology etc.Reboulia: features, anatomy, morphology etc.
Reboulia: features, anatomy, morphology etc.
 
ABHISHEK ANTIBIOTICS PPT MICROBIOLOGY // USES OF ANTIOBIOTICS TYPES OF ANTIB...
ABHISHEK ANTIBIOTICS PPT MICROBIOLOGY  // USES OF ANTIOBIOTICS TYPES OF ANTIB...ABHISHEK ANTIBIOTICS PPT MICROBIOLOGY  // USES OF ANTIOBIOTICS TYPES OF ANTIB...
ABHISHEK ANTIBIOTICS PPT MICROBIOLOGY // USES OF ANTIOBIOTICS TYPES OF ANTIB...
 
The Mariana Trench remarkable geological features on Earth.pptx
The Mariana Trench remarkable geological features on Earth.pptxThe Mariana Trench remarkable geological features on Earth.pptx
The Mariana Trench remarkable geological features on Earth.pptx
 
Porella : features, morphology, anatomy, reproduction etc.
Porella : features, morphology, anatomy, reproduction etc.Porella : features, morphology, anatomy, reproduction etc.
Porella : features, morphology, anatomy, reproduction etc.
 
X-rays from a Central “Exhaust Vent” of the Galactic Center Chimney
X-rays from a Central “Exhaust Vent” of the Galactic Center ChimneyX-rays from a Central “Exhaust Vent” of the Galactic Center Chimney
X-rays from a Central “Exhaust Vent” of the Galactic Center Chimney
 
Terpineol and it's characterization pptx
Terpineol and it's characterization pptxTerpineol and it's characterization pptx
Terpineol and it's characterization pptx
 

Essentials of Linux Systems Administration for Bioinformatics

  • 1. Essentials of Linux Systems Administration for Bioinformatics José Héctor Gálvez MonBUG March 29, 2017
  • 2. Identifying your role and responsibilities are the first steps when interacting with a new system Regular User System Administrator Security ü ü Backups ü ü Troubleshooting ü ü Software installation Þ ü User management û ü System updates û ü You might be the de facto system administrator of your lab’s workstation!
  • 3. Security should be the No. 1 concern of both users and system administrators Physical access Local users Remote access No system is 100% secure • The human factor is the weakest link • Having a security policy will help prevent exploits • passwd • chmod Linux Security Modules: • selinux
  • 4. In bioinformatics and scientific computing regular backups are especially important Raw data üüü User files (/home) üü System configuration files üü Log files ü Software Þ /tmp û Pseudo-filesystems/swap û • rsync • tar,dd,dump,restore • RAID arrays (fdisk) What to back up? Treat data as read-only: • Only allow programs to read data and create new, separate files of results • Always make back-ups
  • 5. All users should know the basics of troubleshooting and ask for assistance when necessary 1. Characterize the problem 2. Reproduce the problem 3. Always try easy things first 4. Eliminate possible causes, one at a time 5. Check system logs • /var/log/messages • /var/log/secure • kill, killall, pkill • nice,unice • ps,top,iostat Keep a checklist For example: • Check exit status • Check man pages • Check file permissions…
  • 6. Bioinformatics requires the use of custom software, so having an installation policy is a good idea • yum,APT • make • git clone • Package managers offer advantages • Automation • Scalability • Repeatability • Security • Auditing • Other online repositories (github, bitbucket) can provide similar advantages
  • 7. Systems with several users require constant monitoring and limited permissions • For regular users, consider: • Expiry dates • Memory quota/limited priority • Periodic password changes • Lock or disable inactive accounts • Create user groups to manage several users at once • Use the root account (or sudo) only when absolutely necessary • useradd,groupadd • usermod,groupmod • passwd,chage • chmod,chown Never edit these files directly! • /etc/passwd • /etc/group • /etc/shadow
  • 8. An out-of-date system is less secure and might run slower than one that is regularly updated • Regular schedule for updates • Never skip security updates • Package Management Systems: • Regular updates • “Smart-upgrade” • Verify package integrity • Remove packages • Clean cache • APT,yum • RPM,DPKG
  • 9. A well-administered system is key for system reliability and research reproducibility Further resources: