Yushi Omote, profile picture
Uploaded byYushi Omote
2,537 views

OSb: OSv on BitVisor

The document discusses running OSv (a lightweight hypervisor) on BitVisor (a virtualization platform). It summarizes steps taken to implement a virtual Virtio NIC on BitVisor by faking the PCI configuration space, memory mapped I/O, and interrupts of the physical NIC (PRO/1000) to appear as a Virtio NIC to the OSv hypervisor. This allows OSv network drivers to function without modification by redirecting requests to the real NIC through hooks installed by BitVisor.

Embed presentation

Downloaded 15 times
OSb: OSv on BitVisor @ysmoo Saturday, October 18, 14
BitVisor App App App BitVisor Hardware OS http://www.justis.as-1.co.jp Saturday, October 18, 14
OSv VMM Hardware App OSv http://medical-care.feed.jp Saturday, October 18, 14
BitVisor Saturday, October 18, 14
BitVisor OSv Saturday, October 18, 14
BitVisor OSv http://www.root.ne.jp/nishide/shs/ Saturday, October 18, 14
OSv on BitVisor BitVisor Hardware App OSv Saturday, October 18, 14
OSv on BitVisor BitVisor Hardware App OSv OSb Saturday, October 18, 14
OSv on BitVisor BitVisor Hardware App OSv What the fuck no Virtio ! OSb Physical interface sucks ! What the hell is PRO/1000 ! Saturday, October 18, 14
OSv on BitVisor BitVisor Hardware App OSv What the fuck no Virtio ! OSb Physical interface sucks ! What the hell is PRO/1000 ! You have no choice. Virtio Saturday, October 18, 14
~ The road to OSb ~ Saturday, October 18, 14
OSv code reading • Boot process • Some drivers Saturday, October 18, 14
OSv code reading • Boot process • Some drivers - MBR - Read local disk with INT13/42. - Load command line, boot loader, OSv kernel. - Get memory map with INT15/E820. - Setup segment descriptors/page tables. - Switch to 64-bit mode. - premain() - main() ... Saturday, October 18, 14
OSv code reading • Boot process • Some drivers - MBR - Read local disk with INT13/42. - Load command line, boot loader, OSv kernel. - Get memory map with INT15/E820. - Setup segment descriptors/page tables. - Switch to 64-bit mode. - premain() - main() ... - Serial / VGA output. - SATA. - Virtio NIC/BLK/RNG/SCSI. - ACPI. - APIC. ... Saturday, October 18, 14
OSv code reading • Boot process • Some drivers - MBR - Read local disk with INT13/42. - Load command line, boot loader, OSv kernel. - Get memory map with INT15/E820. - Setup segment descriptors/page tables. - Switch to 64-bit mode. - premain() - main() ... - Serial / VGA output. - SATA. - Virtio NIC/BLK/RNG/SCSI. - ACPI. - APIC. ... Straightforward... Saturday, October 18, 14
Booting OSb ./scripts/run.py Saturday, October 18, 14
Booting OSb In the case of normal OSv... ./scripts/run.py OSv VMM Saturday, October 18, 14
Booting OSb Hardware ./scripts/run.py Saturday, October 18, 14
Booting OSb Hardware ./scripts/run.py Image Update Saturday, October 18, 14
Booting OSb Hardware ./scripts/run.py Image Update IPMI Saturday, October 18, 14
Booting OSb Hardware ./scripts/run.py Image Update PXE Boot IPMI Saturday, October 18, 14
Booting OSb Hardware ./scripts/run.py Image Update PXE Boot IPMI BitVisor Saturday, October 18, 14
Booting OSb Hardware ./scripts/run.py Image Update PXE Boot IPMI BitVisor OSv Network Boot Saturday, October 18, 14
Booting OSb Hardware ./scripts/run.py Image Update PXE Boot IPMI BitVisor OSv Network Boot App Saturday, October 18, 14
Booting OSb BitVisor Hardware App OSv Network Boot IPMI ./scripts/run.py TTY Image Update PXE Boot Saturday, October 18, 14
ACPI workaround drivers/acpi.cc: // Copy the root table list to dynamic memory if (!is_bitvisor()) { status = AcpiReallocateRootTable(); if (ACPI_FAILURE(status)) { acpi_e("AcpiReallocateRootTable failed: %sn", AcpiFormatException(status)); return; } } Saturday, October 18, 14
ACPI workaround drivers/acpi.cc: // Copy the root table list to dynamic memory if (!is_bitvisor()) { status = AcpiReallocateRootTable(); if (ACPI_FAILURE(status)) { acpi_e("AcpiReallocateRootTable failed: %sn", AcpiFormatException(status)); return; } } Triple fault Saturday, October 18, 14
ACPI workaround drivers/acpi.cc: // Copy the root table list to dynamic memory if (!is_bitvisor()) { status = AcpiReallocateRootTable(); if (ACPI_FAILURE(status)) { acpi_e("AcpiReallocateRootTable failed: %sn", AcpiFormatException(status)); return; } } Triple fault Skip in case of OSb Saturday, October 18, 14
ACPI workaround drivers/acpi.cc: // Copy the root table list to dynamic memory if (!is_bitvisor()) { status = AcpiReallocateRootTable(); if (ACPI_FAILURE(status)) { acpi_e("AcpiReallocateRootTable failed: %sn", AcpiFormatException(status)); return; } } Triple fault Skip in case of OSb Machine-specific...? Saturday, October 18, 14
Hello world ! Saturday, October 18, 14
Performance? 20.75& 21.20& 25.00& 20.00& 15.00& 10.00& 5.00& 0.00& OSb& OSv& Elapsed(Time((sec) for((12(billion(6mes)(val++; Saturday, October 18, 14
Virtio NIC BitVisor Hardware App Actually PRO/1000... OSv Saturday, October 18, 14
Virtio NIC BitVisor Hardware App OSv Virtio NIC Actually PRO/1000... Fake Virtio NIC... Saturday, October 18, 14
Virtio NIC BitVisor Hardware App OSv Virtio NIC Actually PRO/1000... Fake Virtio NIC... Hook PCI config access, MMIO, PIO and fake! Saturday, October 18, 14
Faking PCI configuration space • Faking IDs • Faking BARs • Faking capabilities Saturday, October 18, 14
Faking IDs 0x1AF4 (Virtio Device) Saturday, October 18, 14
Faking IDs 0x1AF4 (Virtio Device) 0x1000 (Virtio NIC) Saturday, October 18, 14
Faking IDs 0x1AF4 (Virtio Device) 0x1000 (Virtio NIC) 0 (Legacy Virtio) Saturday, October 18, 14
Faking IDs 0x1AF4 (Virtio Device) 0x1000 (Virtio NIC) 0 (Legacy Virtio) 1 (Virtio NIC) Saturday, October 18, 14
Faking BARs BAR0: IO space for Virtio BAR1: MMIO space for MSI-X Saturday, October 18, 14
Faking BARs BAR0: IO space for Virtio BAR1: MMIO space for MSI-X = PRO/1000 IO space Saturday, October 18, 14
Faking BARs BAR0: IO space for Virtio BAR1: MMIO space for MSI-X = PRO/1000 IO space = PRO/1000 MMIO space Saturday, October 18, 14
Faking capabilities Add MSI-X capability Saturday, October 18, 14
Faking capabilities Add MSI-X capability Support 3 vectors Saturday, October 18, 14
Faking capabilities Add MSI-X capability Support 3 vectors Vector 0: Reception Saturday, October 18, 14
Faking capabilities Add MSI-X capability Support 3 vectors Vector 0: Reception Vector 1: Transmission Saturday, October 18, 14
Faking capabilities Add MSI-X capability Support 3 vectors Vector 0: Reception Vector 1: Transmission Vector 2: Control Saturday, October 18, 14
Virtio NIC Operations • Virtio ring • Packet transmission • Packet reception Saturday, October 18, 14
Virtio ring Controlled by these registers BAR0 (IO) Saturday, October 18, 14
Virtio ring Controlled by these registers 3 rings available BAR0 (IO) Saturday, October 18, 14
Virtio ring BAR0 Ring 0: Reception (IO) Controlled by these registers 3 rings available Saturday, October 18, 14
Virtio ring Controlled by these registers 3 rings available Ring 0: Reception Ring 1: Transmission BAR0 (IO) Saturday, October 18, 14
Virtio ring Controlled by these registers 3 rings available Ring 0: Reception Ring 1: Transmission Ring 2: Control BAR0 (IO) Saturday, October 18, 14
Virtio ring Controlled by these registers 3 rings available Ring 0: Reception Ring 1: Transmission Ring 2: Control BAR0 (IO) (Memory) Saturday, October 18, 14
Virtio ring Controlled by these registers 3 rings available Ring 0: Reception Ring 1: Transmission Ring 2: Control BAR0 (IO) (Memory) Driver 2 Device Device 2 Driver Saturday, October 18, 14
Packet transmission OSv (Driver) BitVisor (Device) PRO/1000 Saturday, October 18, 14
Packet transmission OSv (Driver) BitVisor (Device) Req. PRO/1000 Req. Req. Saturday, October 18, 14
Packet transmission OSv (Driver) BitVisor (Device) Req. PRO/1000 Req. Req. Req. Req. Req. Saturday, October 18, 14
Packet transmission OSv (Driver) BitVisor (Device) Req. PRO/1000 Req. TX Ring Req. Req. Req. Req. Req. Req. Req. Saturday, October 18, 14
Packet transmission OSv (Driver) BitVisor (Device) Req. PRO/1000 Req. TX Ring Req. Req. Req. Req. Req. Req. Req. Req. Saturday, October 18, 14
Packet transmission OSv (Driver) BitVisor (Device) Req. PRO/1000 Req. TX Ring Req. Req. Req. Req. Req. Req. Req. Req. Notify! (PIO) Saturday, October 18, 14
Packet transmission OSv (Driver) BitVisor (Device) Req. PRO/1000 Req. TX Ring Req. Req. Req. Req. Req. Req. Req. Req. Notify! (PIO) Req. Req. Saturday, October 18, 14
Packet transmission OSv (Driver) BitVisor (Device) Req. PRO/1000 Req. TX Ring Req. Req. Req. Req. Req. Req. Req. Req. Notify! (PIO) Req. Req. Saturday, October 18, 14
Packet transmission OSv (Driver) BitVisor (Device) Req. PRO/1000 Req. TX Ring Req. Req. Req. Req. Req. Req. Req. Req. Notify! (PIO) Req. Req. Reuse Saturday, October 18, 14
Packet reception OSv (Driver) BitVisor (Device) Buf. PRO/1000 Buf. RX Ring Buf. Buf. Buf. Buf. Buf. Buf. Buf. Saturday, October 18, 14
Packet reception OSv (Driver) BitVisor (Device) Buf. PRO/1000 Buf. RX Ring Buf. Buf. Buf. Buf. Buf. Buf. Buf. Buf. Saturday, October 18, 14
Packet reception OSv (Driver) BitVisor (Device) Buf. PRO/1000 Buf. RX Ring Buf. Buf. Buf. Buf. Buf. Buf. Buf. Buf. Buf. Saturday, October 18, 14
Packet reception OSv (Driver) BitVisor (Device) Buf. PRO/1000 Buf. RX Ring Buf. Buf. Buf. Buf. Buf. Buf. Buf. Buf. Buf. Buf. Saturday, October 18, 14
Packet reception OSv (Driver) BitVisor (Device) Buf. PRO/1000 Buf. RX Ring Buf. Buf. Buf. Buf. Buf. Buf. Buf. Buf. Buf. Buf. Saturday, October 18, 14
Packet reception OSv (Driver) BitVisor (Device) Buf. PRO/1000 Buf. RX Ring Buf. Buf. Buf. Buf. Buf. Buf. Buf. Buf. Buf. Buf. Int! Saturday, October 18, 14
Packet reception OSv (Driver) BitVisor (Device) Buf. PRO/1000 Buf. RX Ring Buf. Buf. Buf. Buf. Buf. Buf. Buf. Buf. Int! Buf. Buf. Receive Saturday, October 18, 14
Interrupt BAR1 (MMIO) MSI-X Message Data: Int. vector number (e.g. 0x26) VMX event injection for virtual interrupts Saturday, October 18, 14
DHCP succeeded ! Saturday, October 18, 14
Summary future work • Summary • Booting OSv on BitVisor • Virtio NIC • Future work • Further testing • Virtio BLK/RNG/... Saturday, October 18, 14
Thank you ! http://www.root.ne.jp/nishide/shs/ Saturday, October 18, 14

More Related Content

PDF
OS*: OSv on *
byYushi Omote
 
PPTX
Programming OpenRISC on Altera De0_nano
byYi-Chiao
 
PPTX
Wi-Fi Modem For the Commodore 64
byLeif Bloomquist
 
PDF
最後の楽園の開発をちょこっとだけ手伝った話
bynullnilaki
 
KEY
SMP Implementation for OpenBSD/sgi [Japanese Edition]
byTakuya ASADA
 
KEY
OpenBSD/sgi SMP implementation for Origin 350
byTakuya ASADA
 
PPTX
TinkerSoc Electronics 101
byOmer Kilic
 
PPTX
More Mad Science for the Commodore 64 (ECCC 2015)
byLeif Bloomquist
 
OS*: OSv on *
byYushi Omote
 
Programming OpenRISC on Altera De0_nano
byYi-Chiao
 
Wi-Fi Modem For the Commodore 64
byLeif Bloomquist
 
最後の楽園の開発をちょこっとだけ手伝った話
bynullnilaki
 
SMP Implementation for OpenBSD/sgi [Japanese Edition]
byTakuya ASADA
 
OpenBSD/sgi SMP implementation for Origin 350
byTakuya ASADA
 
TinkerSoc Electronics 101
byOmer Kilic
 
More Mad Science for the Commodore 64 (ECCC 2015)
byLeif Bloomquist
 

What's hot

PDF
Unveiling EMUX - ARM and MIPS IoT Emulation Framework
bySaumil Shah
 
PDF
What's New in ES6 for Web Devs
byRami Sayar
 
PDF
Hack.LU 2018 ARM IoT Firmware Emulation Workshop
bySaumil Shah
 
PPTX
Stm32 develop tool introduction
by冠宇 陳
 
PDF
INSIDE ARM-X Cansecwest 2020
bySaumil Shah
 
PDF
Introducing ARM-X
bySaumil Shah
 
PDF
IoT Chess 16th April Berlin
byLars Gregori
 
PDF
Retrospective: Seven VM Engineering Years
byESUG
 
PDF
Kernel Recipes 2013 - kconfig-frontends, a packaging of the kconfig parser an...
byAnne Nicolas
 
PPT
Internet Technology for the Commodore 64
byLeif Bloomquist
 
PDF
Control-M 800 - Infrastructure Example
byOhio University
 
PDF
Vm ware fuzzing - defcon russia 20
byDefconRussia
 
PDF
Mikhail Belopuhov: OpenBSD: Where is crypto headed?
byYandex
 
PDF
ARM IoT Firmware Emulation Workshop
bySaumil Shah
 
PDF
【Manifes2018】私が考えるPCの"最新"学習方法
by竹田 大将
 
PDF
DOD 2016 - Ignat Korchagin - Managing Server Secrets at Scale
byPROIDEA
 
PDF
VA-API rust-binding (GStreamer Conference 2017)
byIgalia
 
PPTX
[5]投影片 futurewad樹莓派研習會 141218
byCAVEDU Education
 
Unveiling EMUX - ARM and MIPS IoT Emulation Framework
bySaumil Shah
 
What's New in ES6 for Web Devs
byRami Sayar
 
Hack.LU 2018 ARM IoT Firmware Emulation Workshop
bySaumil Shah
 
Stm32 develop tool introduction
by冠宇 陳
 
INSIDE ARM-X Cansecwest 2020
bySaumil Shah
 
Introducing ARM-X
bySaumil Shah
 
IoT Chess 16th April Berlin
byLars Gregori
 
Retrospective: Seven VM Engineering Years
byESUG
 
Kernel Recipes 2013 - kconfig-frontends, a packaging of the kconfig parser an...
byAnne Nicolas
 
Internet Technology for the Commodore 64
byLeif Bloomquist
 
Control-M 800 - Infrastructure Example
byOhio University
 
Vm ware fuzzing - defcon russia 20
byDefconRussia
 
Mikhail Belopuhov: OpenBSD: Where is crypto headed?
byYandex
 
ARM IoT Firmware Emulation Workshop
bySaumil Shah
 
【Manifes2018】私が考えるPCの"最新"学習方法
by竹田 大将
 
DOD 2016 - Ignat Korchagin - Managing Server Secrets at Scale
byPROIDEA
 
VA-API rust-binding (GStreamer Conference 2017)
byIgalia
 
[5]投影片 futurewad樹莓派研習會 141218
byCAVEDU Education
 

Similar to OSb: OSv on BitVisor

PDF
OSb: OSv on BitVisor (2)
byYushi Omote
 
PDF
Windows guest debugging presentation from KVM Forum 2012
byYan Vugenfirer
 
PDF
XS Boston 2008 Self IO Emulation
byThe Linux Foundation
 
PDF
XS Boston 2008 VT-D PCI
byThe Linux Foundation
 
PDF
Project ACRN Device Passthrough Introduction
byProject ACRN
 
PDF
Project ACRN expose and pass through platform hidden PCIe devices to SOS
byProject ACRN
 
PDF
DEF CON 27 - JESSE MICHAEL - get off the kernel if you can't drive
byFelipe Prado
 
PDF
Implementing SR-IOv failover for Windows guests during live migration
byYan Vugenfirer
 
PDF
Buiding a better Userspace - The current and future state of QEMU and KVM int...
byaliguori
 
PDF
Graphics virtualization
byThe Linux Foundation
 
PDF
Graphics virtualization
byThe Linux Foundation
 
PDF
Status update-qemu-pcie
byThe Linux Foundation
 
PDF
Fine-grained fault tolerance using device checkpoints
byasimkadav
 
PDF
Vortex86 Sx Linux How To
byRogelio Canedo
 
PDF
[Ruxcon] Breaking virtualization by switching the cpu to virtual 8086 mode
byMoabi.com
 
PDF
BlueHat v18 || Straight outta v mware - modern exploitation of the svga devic...
byBlueHat Security Conference
 
PDF
HKG18-110 - net_mdev: Fast path user space I/O
byLinaro
 
PDF
Don't Tell Joanna the Virtualized Rootkit is Dead (Blackhat 2007)
byNate Lawson
 
PPTX
Slideshare - PCIe
byJin Wu
 
PDF
Xen summit spring2010_tom_woller_amd
byThe Linux Foundation
 
OSb: OSv on BitVisor (2)
byYushi Omote
 
Windows guest debugging presentation from KVM Forum 2012
byYan Vugenfirer
 
XS Boston 2008 Self IO Emulation
byThe Linux Foundation
 
XS Boston 2008 VT-D PCI
byThe Linux Foundation
 
Project ACRN Device Passthrough Introduction
byProject ACRN
 
Project ACRN expose and pass through platform hidden PCIe devices to SOS
byProject ACRN
 
DEF CON 27 - JESSE MICHAEL - get off the kernel if you can't drive
byFelipe Prado
 
Implementing SR-IOv failover for Windows guests during live migration
byYan Vugenfirer
 
Buiding a better Userspace - The current and future state of QEMU and KVM int...
byaliguori
 
Graphics virtualization
byThe Linux Foundation
 
Graphics virtualization
byThe Linux Foundation
 
Status update-qemu-pcie
byThe Linux Foundation
 
Fine-grained fault tolerance using device checkpoints
byasimkadav
 
Vortex86 Sx Linux How To
byRogelio Canedo
 
[Ruxcon] Breaking virtualization by switching the cpu to virtual 8086 mode
byMoabi.com
 
BlueHat v18 || Straight outta v mware - modern exploitation of the svga devic...
byBlueHat Security Conference
 
HKG18-110 - net_mdev: Fast path user space I/O
byLinaro
 
Don't Tell Joanna the Virtualized Rootkit is Dead (Blackhat 2007)
byNate Lawson
 
Slideshare - PCIe
byJin Wu
 
Xen summit spring2010_tom_woller_amd
byThe Linux Foundation
 

Recently uploaded

PPTX
Natural Gas fundamentals and GRU for associated gas trap.pptx
byengineerhassan
 
PPT
Pointer in C: declaration and initialization
byMinakshee Patil
 
PDF
Presentation-on-Energy-Transition-in-Bangladesh-Employment-and-Skills.pdf
bysyedSajib8
 
PPTX
Preventive Maintenance for Material Handling Equipment — Complete Guide
byMaintWiz Technologies Private Limited
 
PPTX
ISO 14224 Compliance & CMMS Software — A Comprehensive Guide for Reliable Mai...
byMaintWiz Technologies Private Limited
 
PPTX
Basic Electrical Engineering-Introduction to Light Sources
byKhuman Haobam
 
PDF
Lecture -06-Hybrid Policies - Chapter 7- Weeks 6-7.pdf
bysalaarmike
 
PPTX
The Importance of Maintenance Budgets — Maximize Reliability & Control Costs ...
byMaintWiz Technologies Private Limited
 
PPTX
Importance of Asset Register in Maintenance Management
byMaintWiz Technologies Private Limited
 
PPTX
TPM Metrics & Measurement: Drive Performance Excellence with TPM | MaintWiz
byMaintWiz Technologies Private Limited
 
PPTX
Lean Maintenance: Streamlining Operations for Efficiency & Reliability
byMaintWiz Technologies Private Limited
 
PDF
Albert Pintoy - Specializing In Low-Latency
byAlbert Pintoy
 
PPTX
IEC60079-10-1 -Annex F -Hazardous Area Classification -HAC-Annex F.pptx
byasifmirzamakki
 
PPTX
Best CMMS for IoT Integration: Real-Time Asset Intelligence & Smart Maintenan...
byMaintWiz Technologies Private Limited
 
PDF
CV_Rahul_ELV Project Engineer_8 Years Experience
byRahulSushruth
 
PDF
ACI 318-2205_American Concrete Institute.pdf
byericaguilerasoto1
 
PPTX
Security and Contingency Planning presentation.pptx
byNAVEENKUMAR996013
 
PPTX
Technology Stack Evolution: Analyzing Programming Language & Database Trends ...
byzouhairfezzaz54
 
PDF
Narrows Planning Collective Transportation Capstone.pdf
bycj2392
 
PPTX
Inventory Excellence: Achieve Efficient Inventory Management with CMMS
byMaintWiz Technologies Private Limited
 
Natural Gas fundamentals and GRU for associated gas trap.pptx
byengineerhassan
 
Pointer in C: declaration and initialization
byMinakshee Patil
 
Presentation-on-Energy-Transition-in-Bangladesh-Employment-and-Skills.pdf
bysyedSajib8
 
Preventive Maintenance for Material Handling Equipment — Complete Guide
byMaintWiz Technologies Private Limited
 
ISO 14224 Compliance & CMMS Software — A Comprehensive Guide for Reliable Mai...
byMaintWiz Technologies Private Limited
 
Basic Electrical Engineering-Introduction to Light Sources
byKhuman Haobam
 
Lecture -06-Hybrid Policies - Chapter 7- Weeks 6-7.pdf
bysalaarmike
 
The Importance of Maintenance Budgets — Maximize Reliability & Control Costs ...
byMaintWiz Technologies Private Limited
 
Importance of Asset Register in Maintenance Management
byMaintWiz Technologies Private Limited
 
TPM Metrics & Measurement: Drive Performance Excellence with TPM | MaintWiz
byMaintWiz Technologies Private Limited
 
Lean Maintenance: Streamlining Operations for Efficiency & Reliability
byMaintWiz Technologies Private Limited
 
Albert Pintoy - Specializing In Low-Latency
byAlbert Pintoy
 
IEC60079-10-1 -Annex F -Hazardous Area Classification -HAC-Annex F.pptx
byasifmirzamakki
 
Best CMMS for IoT Integration: Real-Time Asset Intelligence & Smart Maintenan...
byMaintWiz Technologies Private Limited
 
CV_Rahul_ELV Project Engineer_8 Years Experience
byRahulSushruth
 
ACI 318-2205_American Concrete Institute.pdf
byericaguilerasoto1
 
Security and Contingency Planning presentation.pptx
byNAVEENKUMAR996013
 
Technology Stack Evolution: Analyzing Programming Language & Database Trends ...
byzouhairfezzaz54
 
Narrows Planning Collective Transportation Capstone.pdf
bycj2392
 
Inventory Excellence: Achieve Efficient Inventory Management with CMMS
byMaintWiz Technologies Private Limited
 

OSb: OSv on BitVisor

  • 1.
    OSb: OSv onBitVisor @ysmoo Saturday, October 18, 14
  • 2.
    BitVisor App AppApp BitVisor Hardware OS http://www.justis.as-1.co.jp Saturday, October 18, 14
  • 3.
    OSv VMM Hardware App OSv http://medical-care.feed.jp Saturday, October 18, 14
  • 4.
  • 5.
    BitVisor OSv Saturday,October 18, 14
  • 6.
  • 7.
    OSv on BitVisor BitVisor Hardware App OSv Saturday, October 18, 14
  • 8.
    OSv on BitVisor BitVisor Hardware App OSv OSb Saturday, October 18, 14
  • 9.
    OSv on BitVisor BitVisor Hardware App OSv What the fuck no Virtio ! OSb Physical interface sucks ! What the hell is PRO/1000 ! Saturday, October 18, 14
  • 10.
    OSv on BitVisor BitVisor Hardware App OSv What the fuck no Virtio ! OSb Physical interface sucks ! What the hell is PRO/1000 ! You have no choice. Virtio Saturday, October 18, 14
  • 11.
    ~ The roadto OSb ~ Saturday, October 18, 14
  • 12.
    OSv code reading • Boot process • Some drivers Saturday, October 18, 14
  • 13.
    OSv code reading • Boot process • Some drivers - MBR - Read local disk with INT13/42. - Load command line, boot loader, OSv kernel. - Get memory map with INT15/E820. - Setup segment descriptors/page tables. - Switch to 64-bit mode. - premain() - main() ... Saturday, October 18, 14
  • 14.
    OSv code reading • Boot process • Some drivers - MBR - Read local disk with INT13/42. - Load command line, boot loader, OSv kernel. - Get memory map with INT15/E820. - Setup segment descriptors/page tables. - Switch to 64-bit mode. - premain() - main() ... - Serial / VGA output. - SATA. - Virtio NIC/BLK/RNG/SCSI. - ACPI. - APIC. ... Saturday, October 18, 14
  • 15.
    OSv code reading • Boot process • Some drivers - MBR - Read local disk with INT13/42. - Load command line, boot loader, OSv kernel. - Get memory map with INT15/E820. - Setup segment descriptors/page tables. - Switch to 64-bit mode. - premain() - main() ... - Serial / VGA output. - SATA. - Virtio NIC/BLK/RNG/SCSI. - ACPI. - APIC. ... Straightforward... Saturday, October 18, 14
  • 16.
    Booting OSb ./scripts/run.py Saturday, October 18, 14
  • 17.
    Booting OSb Inthe case of normal OSv... ./scripts/run.py OSv VMM Saturday, October 18, 14
  • 18.
    Booting OSb Hardware ./scripts/run.py Saturday, October 18, 14
  • 19.
    Booting OSb Hardware ./scripts/run.py Image Update Saturday, October 18, 14
  • 20.
    Booting OSb Hardware ./scripts/run.py Image Update IPMI Saturday, October 18, 14
  • 21.
    Booting OSb Hardware ./scripts/run.py Image Update PXE Boot IPMI Saturday, October 18, 14
  • 22.
    Booting OSb Hardware ./scripts/run.py Image Update PXE Boot IPMI BitVisor Saturday, October 18, 14
  • 23.
    Booting OSb Hardware ./scripts/run.py Image Update PXE Boot IPMI BitVisor OSv Network Boot Saturday, October 18, 14
  • 24.
    Booting OSb Hardware ./scripts/run.py Image Update PXE Boot IPMI BitVisor OSv Network Boot App Saturday, October 18, 14
  • 25.
    Booting OSb BitVisor Hardware App OSv Network Boot IPMI ./scripts/run.py TTY Image Update PXE Boot Saturday, October 18, 14
  • 26.
    ACPI workaround drivers/acpi.cc: // Copy the root table list to dynamic memory if (!is_bitvisor()) { status = AcpiReallocateRootTable(); if (ACPI_FAILURE(status)) { acpi_e("AcpiReallocateRootTable failed: %sn", AcpiFormatException(status)); return; } } Saturday, October 18, 14
  • 27.
    ACPI workaround drivers/acpi.cc: // Copy the root table list to dynamic memory if (!is_bitvisor()) { status = AcpiReallocateRootTable(); if (ACPI_FAILURE(status)) { acpi_e("AcpiReallocateRootTable failed: %sn", AcpiFormatException(status)); return; } } Triple fault Saturday, October 18, 14
  • 28.
    ACPI workaround drivers/acpi.cc: // Copy the root table list to dynamic memory if (!is_bitvisor()) { status = AcpiReallocateRootTable(); if (ACPI_FAILURE(status)) { acpi_e("AcpiReallocateRootTable failed: %sn", AcpiFormatException(status)); return; } } Triple fault Skip in case of OSb Saturday, October 18, 14
  • 29.
    ACPI workaround drivers/acpi.cc: // Copy the root table list to dynamic memory if (!is_bitvisor()) { status = AcpiReallocateRootTable(); if (ACPI_FAILURE(status)) { acpi_e("AcpiReallocateRootTable failed: %sn", AcpiFormatException(status)); return; } } Triple fault Skip in case of OSb Machine-specific...? Saturday, October 18, 14
  • 30.
    Hello world ! Saturday, October 18, 14
  • 31.
    Performance? 20.75& 21.20& 25.00& 20.00& 15.00& 10.00& 5.00& 0.00& OSb& OSv& Elapsed(Time((sec) for((12(billion(6mes)(val++; Saturday, October 18, 14
  • 32.
    Virtio NIC BitVisor Hardware App Actually PRO/1000... OSv Saturday, October 18, 14
  • 33.
    Virtio NIC BitVisor Hardware App OSv Virtio NIC Actually PRO/1000... Fake Virtio NIC... Saturday, October 18, 14
  • 34.
    Virtio NIC BitVisor Hardware App OSv Virtio NIC Actually PRO/1000... Fake Virtio NIC... Hook PCI config access, MMIO, PIO and fake! Saturday, October 18, 14
  • 35.
    Faking PCI configurationspace • Faking IDs • Faking BARs • Faking capabilities Saturday, October 18, 14
  • 36.
    Faking IDs 0x1AF4 (Virtio Device) Saturday, October 18, 14
  • 37.
    Faking IDs 0x1AF4 (Virtio Device) 0x1000 (Virtio NIC) Saturday, October 18, 14
  • 38.
    Faking IDs 0x1AF4 (Virtio Device) 0x1000 (Virtio NIC) 0 (Legacy Virtio) Saturday, October 18, 14
  • 39.
    Faking IDs 0x1AF4 (Virtio Device) 0x1000 (Virtio NIC) 0 (Legacy Virtio) 1 (Virtio NIC) Saturday, October 18, 14
  • 40.
    Faking BARs BAR0:IO space for Virtio BAR1: MMIO space for MSI-X Saturday, October 18, 14
  • 41.
    Faking BARs BAR0:IO space for Virtio BAR1: MMIO space for MSI-X = PRO/1000 IO space Saturday, October 18, 14
  • 42.
    Faking BARs BAR0:IO space for Virtio BAR1: MMIO space for MSI-X = PRO/1000 IO space = PRO/1000 MMIO space Saturday, October 18, 14
  • 43.
    Faking capabilities AddMSI-X capability Saturday, October 18, 14
  • 44.
    Faking capabilities AddMSI-X capability Support 3 vectors Saturday, October 18, 14
  • 45.
    Faking capabilities AddMSI-X capability Support 3 vectors Vector 0: Reception Saturday, October 18, 14
  • 46.
    Faking capabilities AddMSI-X capability Support 3 vectors Vector 0: Reception Vector 1: Transmission Saturday, October 18, 14
  • 47.
    Faking capabilities AddMSI-X capability Support 3 vectors Vector 0: Reception Vector 1: Transmission Vector 2: Control Saturday, October 18, 14
  • 48.
    Virtio NIC Operations • Virtio ring • Packet transmission • Packet reception Saturday, October 18, 14
  • 49.
    Virtio ring Controlledby these registers BAR0 (IO) Saturday, October 18, 14
  • 50.
    Virtio ring Controlledby these registers 3 rings available BAR0 (IO) Saturday, October 18, 14
  • 51.
    Virtio ring BAR0Ring 0: Reception (IO) Controlled by these registers 3 rings available Saturday, October 18, 14
  • 52.
    Virtio ring Controlledby these registers 3 rings available Ring 0: Reception Ring 1: Transmission BAR0 (IO) Saturday, October 18, 14
  • 53.
    Virtio ring Controlledby these registers 3 rings available Ring 0: Reception Ring 1: Transmission Ring 2: Control BAR0 (IO) Saturday, October 18, 14
  • 54.
    Virtio ring Controlledby these registers 3 rings available Ring 0: Reception Ring 1: Transmission Ring 2: Control BAR0 (IO) (Memory) Saturday, October 18, 14
  • 55.
    Virtio ring Controlledby these registers 3 rings available Ring 0: Reception Ring 1: Transmission Ring 2: Control BAR0 (IO) (Memory) Driver 2 Device Device 2 Driver Saturday, October 18, 14
  • 56.
    Packet transmission OSv (Driver) BitVisor (Device) PRO/1000 Saturday, October 18, 14
  • 57.
    Packet transmission OSv (Driver) BitVisor (Device) Req. PRO/1000 Req. Req. Saturday, October 18, 14
  • 58.
    Packet transmission OSv (Driver) BitVisor (Device) Req. PRO/1000 Req. Req. Req. Req. Req. Saturday, October 18, 14
  • 59.
    Packet transmission OSv (Driver) BitVisor (Device) Req. PRO/1000 Req. TX Ring Req. Req. Req. Req. Req. Req. Req. Saturday, October 18, 14
  • 60.
    Packet transmission OSv (Driver) BitVisor (Device) Req. PRO/1000 Req. TX Ring Req. Req. Req. Req. Req. Req. Req. Req. Saturday, October 18, 14
  • 61.
    Packet transmission OSv (Driver) BitVisor (Device) Req. PRO/1000 Req. TX Ring Req. Req. Req. Req. Req. Req. Req. Req. Notify! (PIO) Saturday, October 18, 14
  • 62.
    Packet transmission OSv (Driver) BitVisor (Device) Req. PRO/1000 Req. TX Ring Req. Req. Req. Req. Req. Req. Req. Req. Notify! (PIO) Req. Req. Saturday, October 18, 14
  • 63.
    Packet transmission OSv (Driver) BitVisor (Device) Req. PRO/1000 Req. TX Ring Req. Req. Req. Req. Req. Req. Req. Req. Notify! (PIO) Req. Req. Saturday, October 18, 14
  • 64.
    Packet transmission OSv (Driver) BitVisor (Device) Req. PRO/1000 Req. TX Ring Req. Req. Req. Req. Req. Req. Req. Req. Notify! (PIO) Req. Req. Reuse Saturday, October 18, 14
  • 65.
    Packet reception OSv (Driver) BitVisor (Device) Buf. PRO/1000 Buf. RX Ring Buf. Buf. Buf. Buf. Buf. Buf. Buf. Saturday, October 18, 14
  • 66.
    Packet reception OSv (Driver) BitVisor (Device) Buf. PRO/1000 Buf. RX Ring Buf. Buf. Buf. Buf. Buf. Buf. Buf. Buf. Saturday, October 18, 14
  • 67.
    Packet reception OSv (Driver) BitVisor (Device) Buf. PRO/1000 Buf. RX Ring Buf. Buf. Buf. Buf. Buf. Buf. Buf. Buf. Buf. Saturday, October 18, 14
  • 68.
    Packet reception OSv (Driver) BitVisor (Device) Buf. PRO/1000 Buf. RX Ring Buf. Buf. Buf. Buf. Buf. Buf. Buf. Buf. Buf. Buf. Saturday, October 18, 14
  • 69.
    Packet reception OSv (Driver) BitVisor (Device) Buf. PRO/1000 Buf. RX Ring Buf. Buf. Buf. Buf. Buf. Buf. Buf. Buf. Buf. Buf. Saturday, October 18, 14
  • 70.
    Packet reception OSv (Driver) BitVisor (Device) Buf. PRO/1000 Buf. RX Ring Buf. Buf. Buf. Buf. Buf. Buf. Buf. Buf. Buf. Buf. Int! Saturday, October 18, 14
  • 71.
    Packet reception OSv (Driver) BitVisor (Device) Buf. PRO/1000 Buf. RX Ring Buf. Buf. Buf. Buf. Buf. Buf. Buf. Buf. Int! Buf. Buf. Receive Saturday, October 18, 14
  • 72.
    Interrupt BAR1 (MMIO) MSI-X Message Data: Int. vector number (e.g. 0x26) VMX event injection for virtual interrupts Saturday, October 18, 14
  • 73.
    DHCP succeeded ! Saturday, October 18, 14
  • 74.
    Summary futurework • Summary • Booting OSv on BitVisor • Virtio NIC • Future work • Further testing • Virtio BLK/RNG/... Saturday, October 18, 14
  • 75.
    Thank you ! http://www.root.ne.jp/nishide/shs/ Saturday, October 18, 14