SlideShare a Scribd company logo
1 of 57
Download to read offline
https://ps.zpj.io
From CSI Tool to PicoScenes
Wi-Fi Sensing Middleware
Zhiping Jiang, Jun Luo, Zhe Chen


School of Computer Science and Technology


Xidian University, Xi’an, China


Nanyang Technological University, Singapore


AIWISE, Guangzhou, China
https://ps.zpj.io
Supercharging Your Next Wi-Fi Sensing Research
https://ps.zpj.io
A lecturer with the School of
Computer Science and Technology,
Xidian University, Xi’an, China.


The founder and core developer of
PicoScenes Wi-Fi sensing middleware.
2
Dr. Jiang Zhiping (蒋志平)
https://ps.zpj.io
In the next 40 minutes …
•A recap of the current status of Wi-Fi Sensing research (5)


•A brief introduction to PicoScenes (15)


•Several demo videos (10)


•How can researchers bene
fi
t from PicoScenes? (10)


•Q & A
3
https://ps.zpj.io
Is Wi-Fi sensing still an active
research
fi
eld?
4
https://ps.zpj.io
Seems not …


• Researchers shift to new directions, acoustic, mmWave, LoRa,
ZigBee, RFID, CTC, etc.


• Methodology:


• The model-based papers are extremely hard to get in.


• The learning-based approach thrives, but it is not the silver bullet.
5
Why ?
The cleverest housewife cannot cook without rice ! 😁
巧妇难为⽆⽶之炊
Is Wi-Fi sensing still an active
research
fi
eld?
https://ps.zpj.io
Three Barriers in the Wi-Fi


sensing research
• Unknown baseband design & its in
fl
uence on CSI


• Incapable hardware


• Incapable software


• No technical support from vendors
6
https://ps.zpj.io
Three Barriers in the Wi-Fi sensing
research: incapable hardware
No advanced features


• more radio chains


• external clock


• full-duplex


• ....
7
No low-level controls


• AGC, calibration


• I/Q, PA,


• timing, clocking


• ...
No more PHY layer output


• baseband signals


• OFDM symbols


• CSI by L-LTF


• ...
Out-of-date


• IWL5300/QCA9300/ESP32
based on 802.11n, decade ago;


• BCM43xx, 11ac, near a decade
SDR ? USRP/ WARP/ RTL-SDR/ LimeSDR ?
https://ps.zpj.io
Three Barriers in the Wi-Fi sensing
research: incapable hardware
Ideally, SDR is thought to be the BFG
for Wi-Fi sensing…
8
Actually, SDR is rarely used in the Wi-
Fi sensing research...
https://ps.zpj.io
Three Barriers in the Wi-Fi sensing
research: incapable hardware
9
COTS NIC too good to abandon?
or, SDR hardware too expensive?
USRP B210, $ 1,472.00 USD
There is no


publicly available Wi-Fi
baseband implementations.
The missing Wi-Fi baseband DSP
0101001000100 ...
for SDR
https://ps.zpj.io
Three Barriers in the Wi-Fi sensing
research: incapable software
After 10 years, the software is still very primitive ...


• No multi-NIC control


• No integrated Tx/Rx


• No MPDU payload


• No hardware control


• Deprecated kernel/OS


• No collaborative measurement


• hard to use, far from maturity


• No technical support
10
https://ps.zpj.io
Introducing PicoScenes
Wi-Fi Sensing Middleware
https://ps.zpj.io
What is PicoScenes?
• Still a CSI tool, but a powerful, modern, easy-to-use, and well-documented
one, trying to overcome the hardware and software barriers of Wi-Fi sensing
research.


• First and temporarily the only Wi-Fi 6E-ready CSI tool


• A
fl
exible Wi-Fi sensing middleware supporting plugin mechanism


• Being developed for 5 years, released in Apr. 2021, being used by 58 university
/ research institutes, 31 in China and 27 oversea


• Warmly appreciated by users*


• “Thanks again for this software, and I'm looking forward to seeing it develop
even further!” — Gleen Forbes (Robert Gordon Univ., UK)

• “Thanks for providing an awesome tool” — @wonwon

• “Thanks so much for your amazing work putting together PicoScenes! I just
discovered it the other week but looks to be a really cool piece of kit, huge
congratulations!” — James Bache (Univ. of Exeter, UK)
12
* Comments are excerpted from PicoScenes Issue Tracker.
Visit here!
https://ps.zpj.io
What is PicoScenes?
13
In the hardware aspect…
• Supports the most CSI-extractable hardware


• Intel AX200 series (AX200/210/211)


• Intel 5300 NIC (IWL5300)


• Qualcomm Atheros 9300 (QCA9300)


• more to support …


• Supports SDR into Wi-Fi sensing frontend


• USRP series


• HackRF One (just over 100$ !)


• more to support …


• The
fi
rst and only Wi-Fi 6E-ready CSI Tool


• using AX210/211 NIC


• 802.11ax + 160-MHz BW + 6-GHz band


• 7 continuous 160-MHz channels (5945-7125 MHz)


• up to 8192 subcarriers per packet


An non-exhaustive list of highlights of PicoScenes…
5.25 5.57 6.025 6.185 6.345 6.505 6.650 6.825 6.985
Carrier Frequency (GHz)
30
40
50
60
Magnitude
(dB)
5 GHz Band
only 2 160MHz channels
6 GHz Band
7 160 MHz channels
5.95 6 6.05 6.1
Carrier Frequency (GHz) 10
9
40
45
50
Magnitude
(dB)
Wi-Fi 6E CSI measurement by AX210
Supported HW, including 5 Wi-Fi NICs and SDRs
https://ps.zpj.io
What is PicoScenes?
14
In the hardware aspect…
• Supports the most CSI-extractable hardware


• Intel AX200 series (AX200/210/211)


• Intel 5300 NIC (IWL5300)


• Qualcomm Atheros 9300 (QCA9300)


• more to support …


• Supports SDR into Wi-Fi sensing frontend


• USRP series


• HackRF One (just over 100$ !)


• more to support …


• The
fi
rst and only Wi-Fi 6E-ready CSI Tool


• using AX210/211 NIC


• 802.11ax + 160-MHz BW + 6-GHz band


• 7 continuous 160-MHz channels (5945-7125 MHz)


• up to 8192 subcarriers per packet


• Freely turning RF in 2.4-GHz wide spectrum


• using QCA9300 NIC


• Tunable in 2.2-2.9 and 4.4-6.1 GHz ranges


• Up to 200-MHz BW CSI measurement


• using USRP X310 SDR


• live packet injection & CSI measurement
An non-exhaustive list of highlights of PicoScenes…
20-200 MHz BW CSI measurement by X310
QCA9300 supports 2.4-GHz spectrum w/ variable BW
https://ps.zpj.io
What is PicoScenes?
15
In the software aspect…
• Supports multi-frontend CSI measurement


• concurrent CSI measurement from
heterogeneous HW


• Intuitive device naming


• Wi-Fi baseband implementation


• all-format (a/g/n/ac/ax), up to 4x4 MIMO


• Live packet capture & CSI measurement


• Signal recording & replay


• Packet Injection for all supported frontend


• Supports both Wi-Fi NICs and SDR


An non-exhaustive list of highlights of PicoScenes…
PicoScenes drives a 27-NIC array
High-perf. Wi-Fi baseband codec. w/ MIMO support
https://ps.zpj.io
What is PicoScenes?
16
In the software aspect…
• Supports multi-frontend CSI measurement


• concurrent CSI measurement from
heterogeneous HW


• Intuitive device naming


• Wi-Fi baseband implementation


• all-format (a/g/n/ac/ax), up to 4x4 MIMO


• Live packet capture & CSI measurement


• Signal recording & replay


• Packet Injection for all supported frontend


• Supports both Wi-Fi NICs and SDR


• Plugin mechanism


• Driver + Platform + Plugins architecture


• plugins executes all the end-use functionalities


• Rapid development for complex & realtime
measurement


• Provide of
fi
cial MATLAB/Python Toolbox


• Much easier to use


• apt-based installation & upgrade on Ubuntu
20.04


• Fresh new installation in 10 mins


• The richest documentation
An non-exhaustive list of highlights of PicoScenes…
PicoScenes supports
multi-frontend, and
each runs its own
plugins
NIC 1
COTS or SDR
Plug-ins
Manager
Plug-in n
…
Plug-in 2
Plug-in 1
Rich documentation
https://ps.zpj.io
What is PicoScenes?
17
In the software aspect…
• Supports multi-frontend CSI measurement


• concurrent CSI measurement from
heterogeneous HW


• Intuitive device naming


• Wi-Fi baseband implementation


• all-format (a/g/n/ac/ax), up to 4x4 MIMO


• Live packet capture & CSI measurement


• Signal recording & replay


• Packet Injection for all supported frontend


• Supports both Wi-Fi NICs and SDR


• Plugin mechanism


• Driver + Platform + Plugins architecture


• plugins executes all the end-use functionalities


• Rapid development for complex & realtime
measurement


• Provide of
fi
cial MATLAB/Python Toolbox


• Much easier to use


• apt-based installation & upgrade on Ubuntu
20.04


• Fresh new installation in 10 mins


• The richest documentation
An non-exhaustive list of highlights of PicoScenes…
In the hardware aspect…
• Supports the most CSI-extractable hardware


• Intel AX200 series (AX200/210/211)


• Intel 5300 NIC (IWL5300)


• Qualcomm Atheros 9300 (QCA9300)


• more to support …


• Supports SDR into Wi-Fi sensing frontend


• USRP series


• HackRF One (just over 100$ !)


• more to support …


• The
fi
rst and only Wi-Fi 6E-ready CSI Tool


• using AX210/211 NIC


• 802.11ax + 160-MHz BW + 6-GHz band


• 7 continuous 160-MHz channels (5945-7125 MHz)


• up to 8192 subcarriers per packet


• Freely turning RF in 2.3-GHz wide spectrum


• using QCA9300 NIC


• Tunable in 2.2-2.9 and 4.4-6.1 GHz ranges


• Up to 200-MHz BW CSI measurement


• using USRP X310 SDR


• live packet injection & CSI measurement
https://ps.zpj.io
Demo Videos
• CSI measurement between AP and IWL5300/AX200/210 NICs


• Fully passive CSI measurement by AX200/AX210 NIC


• Packet Injection & CSI measurement between two Wi-Fi NICs


• Packet Injection & CSI measurement between two SDRs


• 6-GHz spectrum scanning with two AX210 NICs


• Installation & Use of PicoScenes MATLAB Toolbox
18
https://ps.zpj.io
Demo 1: CSI Measurement between
AP and AX210 NIC
19
https://ps.zpj.io
Demo 2: Fully Passive CSI
Measurement by AX210 NIC
20
https://ps.zpj.io
Demo 3: 20/160-MHz BW CSI
Measurement between two AX210 NICs
21
https://ps.zpj.io
Demo 4: CSI Measurement between two
SDRs (USRP B210 and HackRF One)
22
https://ps.zpj.io
Demo 5: CSI Measurement between two
SDRs (USRP B210 and HackRF One)
23
https://ps.zpj.io
Demo 6: CSI measurement while freq-
hopping in 6-GHz band using two AX210
24
https://ps.zpj.io
25
Demo 7: Installation & Use
PicoScenes MATLAB Toolbox
PicoScenes MATLAB Toolbox (PMT) provides consistent data parsing
and drag’n’drop style .csi
fi
le decoding.
https://ps.zpj.io
Powerful & Agile CSI
Measurement via PicoScenes
Plugin Mechanism
https://ps.zpj.io
Why plugins?
Without plugin architecture,


event the simplest CSI measurement tool is a hell,


for researchers!
27
https://ps.zpj.io
Why plugins?
Taking random_packets, from Intel 5300 CSI Tool, as an example …
28
random_packets https://
github.com/dhalperi/linux-
80211n-csitool-supplementary/
blob/master/injection/
random_packets:


transmit 802.11n-format packets to the special
00:16:ea:12:34:56 MAC address
• Total of 190 LoC, 6 sections:

1. headers & constants (20 LoC)

2. packet data structure de
fi
nition (10 LoC)

3. Program option handling (30 LoC)

4. Packet generation (70 LoC)

5. Initialize packet injection library (20 LoC)

6. Transmit packets (40 LoC)
2
4
3
5 6
https://ps.zpj.io
Why plugin?
Taking log_to_file, from Intel 5300 CSI Tool, as an example …
29
log_to_
fi
le https://github.com/dhalperi/linux-80211n-
csitool-supplementary/blob/master/netlink/log_to_
fi
le.c
log_to_
fi
le:


receive CSI data from driver and dump to disk
• Total of 150 LoC, 4 sections:

1. headers & constants (30 LoC)

2. Connect to driver via NetLink (30 LoC)

3. Receive data & dump (50 LoC)
2
3
https://ps.zpj.io
Powerful & Agile CSI Measurement
via PicoScenes Plugin Mechanism
Taking “—mode logger”, from PicoScenes EchoProbe plugin, as a comparison …
30
EchoProbe plugin https://gitlab.com/wi
fi
sensing/PicoScenes-PDK
—mode logger of EchoProbe plugin:


receive CSI data from driver and dump to disk
• Essentially, Just 2 LoC
• Grab the frame’s bu
ff
er

• Dump the bu
ff
er to disk via RXSDumper 

• Rest of the work, ALL DONE by PicoScenes middleware !
• Communicating with kernel

• Receiving the raw bu
ff
er

• Package the bu
ff
er to ModularPicoScenesRxFrame format

• Pass the frame to EchoProbe plugin

• etc…
Enabling Researchers to
prototype their plugins
focusing on their CSI
measurement task!
https://ps.zpj.io
Powerful & Agile CSI Measurement
via PicoScenes Plugin Mechanism
With such simplicity, EchoProbe plugin goes far beyond just a CSI logger…
31
EchoProbe plugin https://gitlab.com/wi
fi
sensing/PicoScenes-PDK
—mode injector of EchoProbe plugin:


packet injection using all support frontends
• Essentially, Just 3 LoC
• Generate frame & specify Tx parameters

• Transmit the frames and wait

• Wait a while a go next frame

• Rest of the work, ALL DONE by PicoScenes middleware !
• generate MPDU bu
ff
er,

• initiate & transmit MPDU bu
ff
er via COTS NICs

• or, generate signal transmit PPDU signal via SDR

• etc…
2. Transmit
1. Generate frame &
Specify Tx parameters
https://ps.zpj.io
Powerful & Agile CSI Measurement
via PicoScenes Plugin Mechanism
With such simplicity, EchoProbe plugin goes far beyond just a CSI logger…
32
EchoProbe plugin https://gitlab.com/wi
fi
sensing/PicoScenes-PDK
—mode responder of EchoProbe plugin:


receive packets & transmit them back to initiator
• Essentially, Just 50 LoC
• Receive RxFrame (CSI and MPDU content)

• Generate Reply frames (packet the RxFrame as payload)

• Transmit the Reply frames

• Rest of the work, ALL DONE by PicoScenes middleware !
• Frame auto segmentation
• initiate & transmit MPDU bu
ff
er via COTS NICs

• or, generate signal transmit PPDU signal via SDR

• etc…
2. Transmit
1. Generate reply frames
https://ps.zpj.io
Powerful & Agile CSI Measurement
via PicoScenes Plugin Mechanism
With such simplicity, EchoProbe plugin goes far beyond just a CSI logger…
33
EchoProbe plugin https://gitlab.com/wi
fi
sensing/PicoScenes-PDK
—mode initiator of EchoProbe plugin:


initiate the roundtrip and spectrum scanning CSI measurement with the responder side
• Totally, 420 LoC
• Handling various Tx/Rx options

• EchoProbe Request / FreqChangeRequest generation

• Initiator<->Responder ACK-Retry protocol

• Frequency and bandwidth scanning protocol

• Available Frequency and bandwidth enumeration

• Dump the received frames

• …

• Rest of the work, ALL DONE by PicoScenes middleware !
• Frame auto concatenation
• conditional Rx (waiting for Replay frames) and timeout

• Communicate with heterogeneous frontend

• etc…
https://ps.zpj.io
Powerful & Agile CSI Measurement
via PicoScenes Plugin Mechanism
The of
fi
cial PicoScenes Plugin Development Kit (PicoScenes-PDK) opensources three plugins
34
PicoScenes-PDK https://gitlab.com/wi
fi
sensing/PicoScenes-PDK
PicoScenes-PDK project
• Demo Plugin
• a rich-documented tutorial plugin

• Describe how the plugin communicate with the platform, how to handle
RxFrame, 

• EchoProbe Plugin
• 4 modes, injector/logger, initiator/responder

• Single/Round-trip CSI measurement
• Spectrum scanning CSI measurement
• UDP-Forwarder Plugin
• Forward received frames to the remove via UDP

• Total 50 LoC, the core is just 1 LoC.
https://ps.zpj.io
The Architecture of
PicoScenes System
https://ps.zpj.io
36
PicoScenes Architecture
PicoScenes project roots and initiated upon the customized drivers for
QCA9300, IWL5300, and AX200/210/211NICs.
Customized
DVM Driver
Customized
Ath9k Driver
Customized
MVM Driver
Customized
NIC Driver /
SDR Driver
COTS Wi-Fi
NICs / SDR
Customized
DVM Driver
Customized
Ath9k Driver
Customized
MVM Driver
Customized
NIC Driver /
SDR Driver
COTS Wi-Fi
NICs / SDR
https://ps.zpj.io
37
PicoScenes Architecture
Customized
DVM Driver
Customized
Ath9k Driver
Customized
MVM Driver
Customized
NIC Driver /
SDR Driver
COTS Wi-Fi
NICs / SDR
for AX200/210/211 for QCA9300
• Wi-Fi 6E-ready CSI measurement *1
• Unlock the 6-GHz band for AX210/211

• All-format CSI measurement (802.11a/g/n/ac/ax)

• Up to 160-MHz bandwidth (1992 subcarriers per-stream)

• Fully passive CSI measurement for all overheard frames *2
• Packet injection in all format
• Arbitrary carrier freq. tuning (2.2-2.9 and 4.4-6.1 GHz)

• Arbitrary sampling rate tuning (2.5 to 80 MHz)

• Manual Rx-Gain
• Extra Spatial Sounding (ESS)
* Wi-Fi 6E = 11ax + 160MHz BW + 6 GHz band
* CSI measurement in monitor mode supports
all formats and all coding (BCC, LDPC)
for all supported NICs
• Simultaneous multi-NIC CSI measurement
• Rich output, MPDU (packet) content + CSI + various HW status
• Uni
fi
ed data format with backward compatibility
• O
ff
er common HW settings, e.g., Tx/Rx radio chain selection, Tx power
PicoScenes project roots and initiated upon the customized drivers for
QCA9300, IWL5300, and AX200/210/211NICs. Some highlights are …
https://ps.zpj.io
38
PicoScenes Architecture
PicoScenes platform encapsulates the low-level controls into a hierarchy
of AbstractFrontEnd (API).
QCA9300
Frontend
Intel Abstract
Frontend
Abstract COTS
NIC Frontend
Customized
DVM Driver
Customized
Ath9k Driver
Customized
MVM Driver
Customized
NIC Driver /
SDR Driver
COTS Wi-Fi
NICs / SDR
IWL5300
Frontend
AX200/210/211
Frontend
Customized
DVM Driver
Customized
Ath9k Driver
Customized
MVM Driver
Customized
NIC Driver /
SDR Driver
COTS Wi-Fi
NICs / SDR
https://ps.zpj.io
39
PicoScenes Architecture
PicoScenes platform encapsulates the low-level controls into a hierarchy
of AbstractFrontEnd (API). It offers …
QCA9300
Frontend
Intel Abstract
Frontend
Abstract COTS
NIC Frontend
Customized
DVM Driver
Customized
Ath9k Driver
Customized
MVM Driver
Customized
NIC Driver /
SDR Driver
COTS Wi-Fi
NICs / SDR
IWL5300
Frontend
AX200/210/211
Frontend
HW-neutral APIs to
• Transmit packets
• Receive packets
• Receive CSI measurement
• query HW status
• access various settings
• channel

• bandwidth

• carrier frequency

• sampling rate

• Tx parameters

• Tx/Rx gain

• Tx/Rx chain mask

• …
https://ps.zpj.io
40
PicoScenes Architecture
Based on our Wi-Fi baseband implementation, PicoScenes supports
various SDR frontend, and encapsulates them by AbstractSDRFrontEnd
API.
QCA9300
Frontend
Intel Abstract
Frontend
Abstract COTS
NIC Frontend
Customized
DVM Driver
Customized
Ath9k Driver
Customized
MVM Driver
Customized
NIC Driver /
SDR Driver
COTS Wi-Fi
NICs / SDR
IWL5300
Frontend
AX200/210/211
Frontend
QCA9300
Frontend
Intel Abstract
Frontend
Abstract SDR
Frontend
Abstract COTS
NIC Frontend
USRP Frontend
SoapySDR
based FrontEnd
802.11a/g/n/ac/
/ax Baseband Impl.
UHD Driver
SoapySDR w/
various drivers
Customized
DVM Driver
Customized
Ath9k Driver
Customized
MVM Driver
Customized
NIC Driver /
SDR Driver
COTS Wi-Fi
NICs / SDR
IWL5300
Frontend
AX200/210/211
Frontend
Abstract
FrontEnd API
https://ps.zpj.io
41
PicoScenes Architecture
HW-neutral APIs to
• Transmit & receive packets
• Access Full PHY decoding results
• Multi-stage CSI

• Legacy CSI (L-LTF)

• CSI (HT/VHT/HE-LTF)

• Pilot CSI (Pilot subcarriers per
OFDM symbol)

• CFO & SFO estimation

• Raw baseband signal

• etc…

• Complete Control over Tx/Rx PHY
• Carrier frequency

• Sampling rate

• Antenna control

• Tx/Rx gain

• Tx/Rx chain mask

• Time/Clock sync.

• Precoding / beamforming

• Over/down-sampling

• etc…
QCA9300
Frontend
Intel Abstract
Frontend
Abstract SDR
Frontend
Abstract COTS
NIC Frontend
USRP Frontend
SoapySDR
based FrontEnd
802.11a/g/n/ac/
/ax Baseband Impl.
UHD Driver
SoapySDR w/
various drivers
Customized
DVM Driver
Customized
Ath9k Driver
Customized
MVM Driver
Customized
NIC Driver /
SDR Driver
COTS Wi-Fi
NICs / SDR
IWL5300
Frontend
AX200/210/211
Frontend
Abstract
FrontEnd API
Based on our Wi-Fi baseband implementation, PicoScenes supports
various SDR frontend, and encapsulates them by AbstractSDRFrontEnd
API, which offers…
https://ps.zpj.io
42
PicoScenes Architecture
QCA9300
Frontend
Intel Abstract
Frontend
Abstract COTS
NIC Frontend
Customized
DVM Driver
Customized
Ath9k Driver
Customized
MVM Driver
Customized
NIC Driver /
SDR Driver
COTS Wi-Fi
NICs / SDR
IWL5300
Frontend
AX200/210/211
Frontend
QCA9300
Frontend
Intel Abstract
Frontend
Abstract SDR
Frontend
Abstract COTS
NIC Frontend
USRP Frontend
SoapySDR
based FrontEnd
802.11a/g/n/ac/
/ax Baseband Impl.
UHD Driver
SoapySDR w/
various drivers
Customized
DVM Driver
Customized
Ath9k Driver
Customized
MVM Driver
Customized
NIC Driver /
SDR Driver
COTS Wi-Fi
NICs / SDR
IWL5300
Frontend
AX200/210/211
Frontend
Abstract
FrontEnd API
NIC 1
COTS or SDR
QCA9300
Frontend
Intel Abstract
Frontend
Abstract SDR
Frontend
Abstract COTS
NIC Frontend
USRP Frontend
SoapySDR
based FrontEnd
802.11a/g/n/ac/
/ax Baseband Impl.
UHD Driver
SoapySDR w/
various drivers
Customized
DVM Driver
Customized
Ath9k Driver
NIC 2
COTS or SDR
NIC m
COTS or SDR
…
Customized
MVM Driver
NIC 3
COTS or SDR
PicoScenes
Platform
Customized
NIC Driver /
SDR Driver
COTS Wi-Fi
NICs / SDR
Unified NIC
(AbstractNIC API)
IWL5300
Frontend
AX200/210/211
Frontend
Abstract
FrontEnd API
We add another layer of abstraction, AbstractNIC.
https://ps.zpj.io
43
PicoScenes Architecture
NIC 1
COTS or SDR
QCA9300
Frontend
Intel Abstract
Frontend
Abstract SDR
Frontend
Abstract COTS
NIC Frontend
USRP Frontend
SoapySDR
based FrontEnd
802.11a/g/n/ac/
/ax Baseband Impl.
UHD Driver
SoapySDR w/
various drivers
Customized
DVM Driver
Customized
Ath9k Driver
NIC 2
COTS or SDR
NIC m
COTS or SDR
…
Customized
MVM Driver
NIC 3
COTS or SDR
PicoScenes
Platform
Customized
NIC Driver /
SDR Driver
COTS Wi-Fi
NICs / SDR
Unified NIC
(AbstractNIC API)
IWL5300
Frontend
AX200/210/211
Frontend
Abstract
FrontEnd API
HW-neutral APIs to
• Multi-frontend concurrency
• Uni
fi
cation for heterogeneous HW
• Tx & Rx queue control
• Timed batch Tx
• Signal generation

• Conditional Rx for
• certain formats …

• certain type …

• arbitrary criteria 

• CLI option parsing

• etc…
We add another layer of abstraction, AbstractNIC. It offers …
https://ps.zpj.io
44
PicoScenes Architecture
Each AbstractNIC has its
own Plugin Manager, which
hosts and executes the
atop PicoScenes plugin
layer.
NIC 1
COTS or SDR
QCA9300
Frontend
Intel Abstract
Frontend
Abstract SDR
Frontend
Abstract COTS
NIC Frontend
USRP Frontend
SoapySDR
based FrontEnd
802.11a/g/n/ac/
/ax Baseband Impl.
UHD Driver
SoapySDR w/
various drivers
Customized
DVM Driver
Customized
Ath9k Driver
Plug-ins
Manager
NIC 2
COTS or SDR
NIC m
COTS or SDR
…
Plug-ins
Manager
Plug-ins
Manager
Plug-in n
…
Plug-in 2
Plug-in 1
Plug-in n
…
Plug-in 2
Plug-in 1
Plug-in n
…
Plug-in 2
Plug-in 1
Control & Data Flow
Customized
MVM Driver
NIC 3
COTS or SDR
Plug-ins
Manager
Plug-in n
…
Plug-in 2
Plug-in 1
PicoScenes
Application
Plugins
PicoScenes
Platform
Customized
NIC Driver /
SDR Driver
COTS Wi-Fi
NICs / SDR
Unified NIC
(AbstractNIC API)
IWL5300
Frontend
AX200/210/211
Frontend
Abstract
FrontEnd API
NIC 1
COTS or SDR
QCA9300
Frontend
Intel Abstract
Frontend
Abstract SDR
Frontend
Abstract COTS
NIC Frontend
USRP Frontend
SoapySDR
based FrontEnd
802.11a/g/n/ac/
/ax Baseband Impl.
UHD Driver
SoapySDR w/
various drivers
Customized
DVM Driver
Customized
Ath9k Driver
NIC 2
COTS or SDR
NIC m
COTS or SDR
…
Customized
MVM Driver
NIC 3
COTS or SDR
PicoScenes
Platform
Customized
NIC Driver /
SDR Driver
COTS Wi-Fi
NICs / SDR
Unified NIC
(AbstractNIC API)
IWL5300
Frontend
AX200/210/211
Frontend
Abstract
FrontEnd API
https://ps.zpj.io
45
PicoScenes Architecture
Each AbstractNIC has its
own Plugin Manager, which
hosts and executes the
atop PicoScenes plugin
layer. This architecture
offers …
HW-neutral APIs to
• CSI measurement middleware
mechanism
• Extensibility & scalability

• Plugin isolation & concurrency

• Implementing enduser
functionalities
• CSI dump to disk

• packet injection

• CSI data UDP forwarding

• Round-trip CSI measurement

• Freq. hopping CSI measurement

• etc…
NIC 1
COTS or SDR
QCA9300
Frontend
Intel Abstract
Frontend
Abstract SDR
Frontend
Abstract COTS
NIC Frontend
USRP Frontend
SoapySDR
based FrontEnd
802.11a/g/n/ac/
/ax Baseband Impl.
UHD Driver
SoapySDR w/
various drivers
Customized
DVM Driver
Customized
Ath9k Driver
Plug-ins
Manager
NIC 2
COTS or SDR
NIC m
COTS or SDR
…
Plug-ins
Manager
Plug-ins
Manager
Plug-in n
…
Plug-in 2
Plug-in 1
Plug-in n
…
Plug-in 2
Plug-in 1
Plug-in n
…
Plug-in 2
Plug-in 1
Control & Data Flow
Customized
MVM Driver
NIC 3
COTS or SDR
Plug-ins
Manager
Plug-in n
…
Plug-in 2
Plug-in 1
PicoScenes
Application
Plugins
PicoScenes
Platform
Customized
NIC Driver /
SDR Driver
COTS Wi-Fi
NICs / SDR
Unified NIC
(AbstractNIC API)
IWL5300
Frontend
AX200/210/211
Frontend
Abstract
FrontEnd API
https://ps.zpj.io
46
PicoScenes Architecture
Each AbstractNIC has its
own Plugin Manager, which
hosts and executes the
atop PicoScenes plugin
layer. This architecture
offers …
HW-neutral APIs to
• CSI measurement middleware
mechanism
• Extensibility & scalability

• Plugin isolation & concurrency

• Implementing enduser
functionalities
• CSI dump to disk

• packet injection

• CSI data UDP forwarding

• Round-trip CSI measurement

• Freq. hopping CSI measurement

• etc…
NIC 1
COTS or SDR
QCA9300
Frontend
Intel Abstract
Frontend
Abstract SDR
Frontend
Abstract COTS
NIC Frontend
USRP Frontend
SoapySDR
based FrontEnd
802.11a/g/n/ac/
/ax Baseband Impl.
UHD Driver
SoapySDR w/
various drivers
Customized
DVM Driver
Customized
Ath9k Driver
Plug-ins
Manager
NIC 2
COTS or SDR
NIC m
COTS or SDR
…
Plug-ins
Manager
Plug-ins
Manager
Plug-in n
…
Plug-in 2
Plug-in 1
Plug-in n
…
Plug-in 2
Plug-in 1
Plug-in n
…
Plug-in 2
Plug-in 1
Control & Data Flow
Customized
MVM Driver
NIC 3
COTS or SDR
Plug-ins
Manager
Plug-in n
…
Plug-in 2
Plug-in 1
PicoScenes
Application
Plugins
PicoScenes
Platform
Customized
NIC Driver /
SDR Driver
COTS Wi-Fi
NICs / SDR
Unified NIC
(AbstractNIC API)
IWL5300
Frontend
AX200/210/211
Frontend
Abstract
FrontEnd API
NIC 1
COTS or SDR
QCA9300
Frontend
Intel Abstract
Frontend
Abstract SDR
Frontend
Abstract COTS
NIC Frontend
USRP Frontend
SoapySDR
based FrontEnd
802.11a/g/n/ac/
/ax Baseband Impl.
UHD Driver
SoapySDR w/
various drivers
Customized
DVM Driver
Customized
Ath9k Driver
Plug-ins
Manager
NIC 2
COTS or SDR
NIC m
COTS or SDR
…
Plug-ins
Manager
Plug-ins
Manager
Plug-in n
…
Plug-in 2
Plug-in 1
Plug-in n
…
Plug-in 2
Plug-in 1
Plug-in n
…
Plug-in 2
Plug-in 1
Control & Data Flow
Customized
MVM Driver
NIC 3
COTS or SDR
Plug-ins
Manager
Plug-in n
…
Plug-in 2
Plug-in 1
PicoScenes
Application
Plugins
PicoScenes
Platform
Customized
NIC Driver /
SDR Driver
COTS Wi-Fi
NICs / SDR
Unified NIC
(AbstractNIC API)
IWL5300
Frontend
AX200/210/211
Frontend
Abstract
FrontEnd API
https://ps.zpj.io
47
PicoScenes Architecture
Abstract SDR
Frontend
USRP Frontend
SoapySDR
based FrontEnd
802.11a/g/n/ac/
/ax Baseband Impl.
UHD Driver
SoapySDR w/
various drivers
NIC m
COTS or SDR
…
Plug-ins
Manager
Plug-in n
…
Plug-in 2
Plug-in 1
Control & Data Flow
omized
Driver
NIC 3
S or SDR
lug-ins
anager
Plug-in n
…
Plug-in 2
ug-in 1
SDR Driver
(Rx Path)
Coarse
Packet Detection
Fine Packet
Detection
Coarse CFO
Estimation
Fine CFO
Estimation
CFO
Compensation
Legacy Channel
Estimation (L-LTF)
Format Detection
(11a/g/n/ac/ax)
Baseband Signal
Buffer
SIG-Field
Decoding (Non-
HT/HT/VHT/HE)
BCC/LDPC Data
Symbol Decoding
Channel
Estimation (HT/
VHT/HE-LTF)
Rx Report (Rx packet, CSI,
CFO, SFO, pre-EQ symbols,
EVM, scramble, raw signals,
Tx Parameters, etc.)
SDR Driver
(Tx Path)
Inter-Symbol
Windowing
Add CSD,
Symbol Concat.
Legacy Preamble
(L-STF, L-LTF, L-
SIG) in Time Domain
HT/VHT/HE
Preamble (HT/VHT/
HE- STF/LTF/SIG) in
Time Domain
Data Symbols in
Time Domain
Data BCC/LDPC
Encoding
Scrambler +
Interleaving
IFFT + Cyclic
Prefix Insertion
IFFT + Cyclic
Prefix Insertion
IFFT + Cyclic
Prefix Insertion
Legacy Preamble
(L-STF, L-LTF, L-
SIG)
HT/VHT/HE
Preamble
Tx Parameters (Tx data bits,
format, MCS, coding, BW,
precoding, multiuser
configuration, scrambler, etc.)
Data Flow
1
2
3
Tx
Rx
Signal Generation
Coordinator
1 2
3
802.11 a/g/n/ac/ax
Software Baseband
Implementation with
4x4 MIMO Support
/210/211
ntend
Precoding/
Beamforming
stract
End API
MAC Frame
Parsing
Packaging
Decoding Results
https://ps.zpj.io
48
PicoScenes Architecture
NIC 1
COTS or SDR
QCA9300
Frontend
Intel Abstract
Frontend
Abstract SDR
Frontend
Abstract COTS
NIC Frontend
USRP Frontend
SoapySDR
based FrontEnd
802.11a/g/n/ac/
/ax Baseband Impl.
UHD Driver
SoapySDR w/
various drivers
Customized
DVM Driver
Customized
Ath9k Driver
Plug-ins
Manager
NIC 2
COTS or SDR
NIC m
COTS or SDR
…
Plug-ins
Manager
Plug-ins
Manager
Plug-in n
…
Plug-in 2
Plug-in 1
Plug-in n
…
Plug-in 2
Plug-in 1
Plug-in n
…
Plug-in 2
Plug-in 1
Control & Data Flow
Customized
MVM Driver
NIC 3
COTS or SDR
Plug-ins
Manager
Plug-in n
…
Plug-in 2
Plug-in 1
PicoScenes
Application
Plugins
PicoScenes
Platform
Customized
NIC Driver /
SDR Driver
COTS Wi-Fi
NICs / SDR
SDR Driver
(Rx Path)
Coarse
Packet Detection
Fine Packet
Detection
Coarse CFO
Estimation
Fine CFO
Estimation
CFO
Compensation
Legacy Channel
Estimation (L-LTF)
Format Detection
(11a/g/n/ac/ax)
Baseband Signal
Buffer
SIG-Field
Decoding (Non-
HT/HT/VHT/HE)
BCC/LDPC Data
Symbol Decoding
Channel
Estimation (HT/
VHT/HE-LTF)
Rx Report (Rx packet, CSI,
CFO, SFO, pre-EQ symbols,
EVM, scramble, raw signals,
Tx Parameters, etc.)
SDR Driver
(Tx Path)
Inter-Symbol
Windowing
Add CSD,
Symbol Concat.
Legacy Preamble
(L-STF, L-LTF, L-
SIG) in Time Domain
HT/VHT/HE
Preamble (HT/VHT/
HE- STF/LTF/SIG) in
Time Domain
Data Symbols in
Time Domain
Data BCC/LDPC
Encoding
Scrambler +
Interleaving
IFFT + Cyclic
Prefix Insertion
IFFT + Cyclic
Prefix Insertion
IFFT + Cyclic
Prefix Insertion
Legacy Preamble
(L-STF, L-LTF, L-
SIG)
HT/VHT/HE
Preamble
Tx Parameters (Tx data bits,
format, MCS, coding, BW,
precoding, multiuser
configuration, scrambler, etc.)
Data Flow
1
2
3
Tx
Rx
Signal Generation
Coordinator
1 2
3
Unified NIC
(AbstractNIC API)
802.11 a/g/n/ac/ax
Software Baseband
Implementation with
4x4 MIMO Support
IWL5300
Frontend
AX200/210/211
Frontend
Precoding/
Beamforming
Abstract
FrontEnd API
MAC Frame
Parsing
Packaging
Decoding Results
PicoScnees Wi-Fi baseband Implementation
• Transform SDR into a Wi-Fi NIC, live decoding & packet injection
• Full compliance with 802.11a/g/n/ac/ax standard
• Cover most advanced features, e.g., all-format, all-bandwidth (20/40/80/160-MHz), all-codec (BCC/LDPC), all-MCS (0-11),
precoding, beamforming, and up to 4x4 MIMO.
• Full control & access to PHY

• High-performance, decoding in realtime with 0 packet loss in 20/40-MHz bandwidth
https://ps.zpj.io
How PicoScenes can
supercharge your next Wi-
Fi sensing research?
https://ps.zpj.io
New Opportunities Provided by
PicoScenes
50
In the hardware aspect…
• “Wi-Fi 6E” titled Wi-Fi sensing research


• Ultra-bandwidth (UWB) on Wi-Fi


• 160-MHz BW + 6-GHz band (7 x 160-MHz
channels)


• Challenges: Channel stitching?


• 11ax-format, up to 8192 subcarriers per
measurement


• Fully passive Wi-Fi sensing, enhanced by Wi-Fi 6E


• A game changing paradigm for device-free Wi-Fi
sensing


• Transforming surrounding signals into
excitations!


• Challenges: transient signals (spatial and
temporal)


• Wi-Fi sensing in unlicensed spectrum


• Powered by QCA9300 and SDR


• QCA9300: 2.2-2.9 and 4.4-6.1 GHz


• USRP: 10-6000 MHz


• HackRF One 10-7250 MHz


• Much wider and clean spectrum


Spectrum stitching after CSI distortion removal
5.25 5.57 6.025 6.185 6.345 6.505 6.650 6.825 6.985
Carrier Frequency (GHz)
30
40
50
60
Magnitude
(dB)
5 GHz Band
only 2 160MHz channels
6 GHz Band
7 160 MHz channels
5.95 6 6.05 6.1
Carrier Frequency (GHz) 109
40
45
50
Magnitude
(dB)
All 9 160-MHz BW channels in 5&6-GHz
https://ps.zpj.io
New Opportunities Provided by
PicoScenes
51
In the software aspect…
• Concurrent multi-frontend CSI measurement


• Unlock the path to phased array


• High-Wi-Fi baseband implementation & integration


• Signal generation


• Fully controlled Tx/Rx PHY


• Integrated packet injection w/ all-format support


• Arbitrary content injection


• Security research


• Precise Timing (both Tx and Rx)


• precisely timed batch Tx (by SDR)


• ADC-level Rx timestamp (AX200/210 and SDR)


• Much easier & larger-scale CSI measurement in spatial,
temporal, and spectrum.


• Complex & interactive CSI measurement now possible!


• Example code, EchoProbe initiator <-> responder


AX210-based Wi-Fi NIC array
Wire-free CFO estimation & elimination
https://ps.zpj.io
New Opportunities Provided by
PicoScenes
52
In the software aspect…
• Concurrent multi-frontend CSI measurement


• Unlock the path to phased array


• High-Wi-Fi baseband implementation & integration


• Signal generation


• Fully controlled Tx/Rx PHY


• Integrated packet injection w/ all-format support


• Arbitrary content injection


• Security research


• Precise Timing (both Tx and Rx)


• precisely timed batch Tx (by SDR)


• ADC-level Rx timestamp (AX200/210 and SDR)


• Much easier & larger-scale CSI measurement in spatial,
temporal, and spectrum.


• Complex & interactive CSI measurement now possible!


• Example code, EchoProbe initiator <-> responder


In the hardware aspect…
• “Wi-Fi 6E” titled Wi-Fi sensing research


• Ultra-bandwidth (UWB) on Wi-Fi


• 160-MHz BW + 6-GHz band (7 x 160-MHz
channels)


• Challenges: Channel stitching?


• 11ax-format, up to 8192 subcarriers per
measurement


• Fully passive Wi-Fi sensing, enhanced by Wi-Fi 6E


• A game changing paradigm for device-free Wi-Fi
sensing


• Transforming surrounding signals into
excitations!


• Challenges: transient signals (spatial and
temporal)


• Wi-Fi sensing in unlicensed spectrum


• Powered by QCA9300 and SDR


• QCA9300: 2.2-2.9 and 4.4-6.1 GHz


• USRP: 10-6000 MHz


• HackRF One 10-7250 MHz


• Much wider and clean spectrum
https://ps.zpj.io
Resources
• “Eliminating the Barriers: Demystifying Wi-Fi Baseband Design and Introducing the
PicoScenes Wi-Fi Sensing Platform”, Zhiping Jiang, et.al, IEEE Internet of Things
Journal, 2021, https://doi.org/10.1109/JIOT.2021.3104666


• PicoScenes software documents: https://ps.zpj.io


• PicoScenes Issue Tracker (all issues go here!) https://gitlab.com/wi
fi
sensing/
picoscenes-issue-tracker


• Opensource subprojects


• RXS-Parsing-Core Library https://gitlab.com/wi
fi
sensing/rxs_parsing_core 

• PicoScenes Plugin Development Kit (PDK) https://gitlab.com/wi
fi
sensing/PicoScenes-PDK

• PicoScenes MATLAB Toolbox Core (PMT-Core) https://gitlab.com/wi
fi
sensing/PicoScenes-MATLAB-
Toolbox-Core

• PicoScenes Python Toolbox Core (PPT-Core) https://gitlab.com/wi
fi
sensing/PicoScenes-Python-
Toolbox
53
https://ps.zpj.io
Thanks!
https://ps.zpj.io
Extra slides
https://ps.zpj.io
Wi-Fi Sensing CSI Tools (pre PicoScenes)
56
CSI Tools based on COTS Wi-Fi NICs
Hardware
Release
Year
Released

Tool
Highest

Standard
Highlight Features
Citation

Count
Intel 

5300 NIC
2011
Intel 5300
CSI Tool
802.11n First CSI tool, 3T3R, 8-bit ADC >1000
Atheros 

9300 NIC
2015
Atheros
CSI Tool
802.11n 10-bit ADC, 3T3R, full subcarriers (56/114) >100
Broadcom

43xx Chip 2019
Nexmon
CSI
Extractor
802.11ac
First 11ac CSI tool, up to 4T4R on modi
fi
ed
router
<100
ESP 32 2020 Wi-ESP 802.11n Ultra low-cost SoC, standalone, 1T1R >10
CSI Tools based on General SDR / ZynQ
Hardware
Release
Year
Baseband
Implementation
Highlight Features Cost
Citation

Count
USRP 2008 none is public available
widely accepted by academic,
easy for synchronization
$1100 -
25000
>100
WARP v3 2012 PHY/MAC on ZynQ Full PHY + MAC layer Enquiry >10
Open Wi-Fi 2019 PHY/MAC on ZynQ
Full opensource, 

FPGA-based Wi-Fi NIC
$500 - 10000 ~10
https://ps.zpj.io
PicoScenes Data


Production & Consumption
CSI data production & consumption in PicoScenes ecosystem
57
RXS-Parsing-Core Library (Common C++ data structure & parsing, preprocessing routine)
PicoScenes Platform
PicoScenes
Modified NIC Drivers
PicoScenes Plugins
PicoScenes
Baseband Implementation
Data Producers
Data Consumer Matrix
PicoScenes
MATLAB
Toolbox Core
(PMT-Core)
PicoScenes
Python Toolbox
Core (PPT-
Core)
User developed
Wi-Fi Sensing
App (realtime)
In-plugin CSI
data
processing
PicoScenes
built-in
CSI Live Plotter
User developed
CSI processing
library (offline)
Rx in PicoScenesModularRxFrame
Tx in PicoScenesModularTxFrame
Rx in PicoScenesModularRxFrame
Tx in PicoScenesModularTxFrame
Available channels:
in-app exchange
remote UDP
offline .csi file
data packaging
& unpacking
data packaging
& unpacking
common data structure
RXS-Parsing-Core Library https://gitlab.com/wi
fi
sensing/rxs_parsing_core 

PicoScenes Plugin Development Kit (PDK) https://gitlab.com/wi
fi
sensing/PicoScenes-PDK

PicoScenes MATLAB Toolbox Core (PMT-Core) https://gitlab.com/wi
fi
sensing/PicoScenes-MATLAB-Toolbox-Core

PicoScenes Python Toolbox Core (PPT-Core) https://gitlab.com/wi
fi
sensing/PicoScenes-Python-Toolbox

More Related Content

What's hot

Lte lte advanced
Lte lte advancedLte lte advanced
Lte lte advancedHardik_Tank
 
Teleprotection over packet f 30 8-11
Teleprotection over packet f 30 8-11Teleprotection over packet f 30 8-11
Teleprotection over packet f 30 8-11Nir Cohen
 
4 Structure Cabling System Design
4 Structure Cabling System Design4 Structure Cabling System Design
4 Structure Cabling System DesignMrirfan
 
Structured Cabling Technologies for Networking
Structured Cabling Technologies for NetworkingStructured Cabling Technologies for Networking
Structured Cabling Technologies for NetworkingTharindu Kumara
 
How to dimension user traffic in LTE
How to dimension user traffic in LTEHow to dimension user traffic in LTE
How to dimension user traffic in LTEAlthaf Hussain
 
Wi-max Technology PPT
Wi-max Technology PPTWi-max Technology PPT
Wi-max Technology PPTVinay Krishna
 
Wired and Wireless Computer Network Performance Evaluation Using OMNeT++ Simu...
Wired and Wireless Computer Network Performance Evaluation Using OMNeT++ Simu...Wired and Wireless Computer Network Performance Evaluation Using OMNeT++ Simu...
Wired and Wireless Computer Network Performance Evaluation Using OMNeT++ Simu...Jaipal Dhobale
 
Introduction to Computer Networking
Introduction to Computer NetworkingIntroduction to Computer Networking
Introduction to Computer NetworkingAmit Saha
 
What is-twamp
What is-twampWhat is-twamp
What is-twampNir Cohen
 
Presentation on 5G mobile technology
Presentation on 5G mobile technologyPresentation on 5G mobile technology
Presentation on 5G mobile technologyRahul Prajapati
 
1. oeb006910 e nodeb lte v100r008c10 product description issue 1.00
1. oeb006910 e nodeb lte v100r008c10 product description issue 1.001. oeb006910 e nodeb lte v100r008c10 product description issue 1.00
1. oeb006910 e nodeb lte v100r008c10 product description issue 1.00Ankit Mangla
 
Gifi technology full seminar report
Gifi technology full seminar reportGifi technology full seminar report
Gifi technology full seminar reportSusheel Marati
 
Free space optics (fso) seminar report full
Free space optics (fso) seminar report fullFree space optics (fso) seminar report full
Free space optics (fso) seminar report fullDilip Prajapati
 

What's hot (20)

Lte lte advanced
Lte lte advancedLte lte advanced
Lte lte advanced
 
Teleprotection over packet f 30 8-11
Teleprotection over packet f 30 8-11Teleprotection over packet f 30 8-11
Teleprotection over packet f 30 8-11
 
4 Structure Cabling System Design
4 Structure Cabling System Design4 Structure Cabling System Design
4 Structure Cabling System Design
 
Structured Cabling Technologies for Networking
Structured Cabling Technologies for NetworkingStructured Cabling Technologies for Networking
Structured Cabling Technologies for Networking
 
5G Technology
5G Technology5G Technology
5G Technology
 
How to dimension user traffic in LTE
How to dimension user traffic in LTEHow to dimension user traffic in LTE
How to dimension user traffic in LTE
 
5G TECHNOLOGY
5G TECHNOLOGY5G TECHNOLOGY
5G TECHNOLOGY
 
STAR TOPOLOGY
STAR TOPOLOGY STAR TOPOLOGY
STAR TOPOLOGY
 
Wi-max Technology PPT
Wi-max Technology PPTWi-max Technology PPT
Wi-max Technology PPT
 
Data comm and networking
Data comm and networkingData comm and networking
Data comm and networking
 
Wifi Technology ppt
Wifi Technology pptWifi Technology ppt
Wifi Technology ppt
 
Wired and Wireless Computer Network Performance Evaluation Using OMNeT++ Simu...
Wired and Wireless Computer Network Performance Evaluation Using OMNeT++ Simu...Wired and Wireless Computer Network Performance Evaluation Using OMNeT++ Simu...
Wired and Wireless Computer Network Performance Evaluation Using OMNeT++ Simu...
 
Introduction to Computer Networking
Introduction to Computer NetworkingIntroduction to Computer Networking
Introduction to Computer Networking
 
What is-twamp
What is-twampWhat is-twamp
What is-twamp
 
Presentation on 5G mobile technology
Presentation on 5G mobile technologyPresentation on 5G mobile technology
Presentation on 5G mobile technology
 
1. oeb006910 e nodeb lte v100r008c10 product description issue 1.00
1. oeb006910 e nodeb lte v100r008c10 product description issue 1.001. oeb006910 e nodeb lte v100r008c10 product description issue 1.00
1. oeb006910 e nodeb lte v100r008c10 product description issue 1.00
 
Gifi technology full seminar report
Gifi technology full seminar reportGifi technology full seminar report
Gifi technology full seminar report
 
Wi-MAX Technology
Wi-MAX TechnologyWi-MAX Technology
Wi-MAX Technology
 
Switch
SwitchSwitch
Switch
 
Free space optics (fso) seminar report full
Free space optics (fso) seminar report fullFree space optics (fso) seminar report full
Free space optics (fso) seminar report full
 

Similar to PicoScenes Tutorial @ CPS-IOT Week 2022

BLE Localiser (Full) for iOS Dev Scout
BLE Localiser (Full) for iOS Dev ScoutBLE Localiser (Full) for iOS Dev Scout
BLE Localiser (Full) for iOS Dev Scoutyeokm1
 
Sergio González - WiFiSlax 4.0 [RootedCON 2010]
Sergio González - WiFiSlax 4.0 [RootedCON 2010]Sergio González - WiFiSlax 4.0 [RootedCON 2010]
Sergio González - WiFiSlax 4.0 [RootedCON 2010]RootedCON
 
How to Implement SDN Technology in ITB
How to Implement SDN Technology in ITBHow to Implement SDN Technology in ITB
How to Implement SDN Technology in ITBSDNRG ITB
 
Introduction to Fog
Introduction to FogIntroduction to Fog
Introduction to FogCisco DevNet
 
Cisco Multi-Service FAN Solution
Cisco Multi-Service FAN SolutionCisco Multi-Service FAN Solution
Cisco Multi-Service FAN SolutionCisco DevNet
 
Implementing AI: Running AI at the Edge: ClickCV – Providing high-performance...
Implementing AI: Running AI at the Edge: ClickCV – Providing high-performance...Implementing AI: Running AI at the Edge: ClickCV – Providing high-performance...
Implementing AI: Running AI at the Edge: ClickCV – Providing high-performance...KTN
 
HiPEAC 2019 Workshop - Hardware Starter Kit Agri
HiPEAC 2019 Workshop - Hardware Starter Kit Agri HiPEAC 2019 Workshop - Hardware Starter Kit Agri
HiPEAC 2019 Workshop - Hardware Starter Kit Agri Tulipp. Eu
 
Practical Core Bluetooth in IoT & Wearable projects @ UIKonf 2016
Practical Core Bluetooth in IoT & Wearable projects @ UIKonf 2016Practical Core Bluetooth in IoT & Wearable projects @ UIKonf 2016
Practical Core Bluetooth in IoT & Wearable projects @ UIKonf 2016Shuichi Tsutsumi
 
Cisco rv110 w wireless n vpn firewall
Cisco rv110 w wireless n vpn firewallCisco rv110 w wireless n vpn firewall
Cisco rv110 w wireless n vpn firewallIT Tech
 
Network Packet Analysis with Wireshark
Network Packet Analysis with WiresharkNetwork Packet Analysis with Wireshark
Network Packet Analysis with WiresharkJim Gilsinn
 
MaaXBoard, a single board computer based on NXP i.MX 8M solution for iot appl...
MaaXBoard, a single board computer based on NXP i.MX 8M solution for iot appl...MaaXBoard, a single board computer based on NXP i.MX 8M solution for iot appl...
MaaXBoard, a single board computer based on NXP i.MX 8M solution for iot appl...Embest Technology
 
Botprobe - Reducing network threat intelligence big data
Botprobe - Reducing network threat intelligence big data Botprobe - Reducing network threat intelligence big data
Botprobe - Reducing network threat intelligence big data DATA SECURITY SOLUTIONS
 
TechWiseTV Workshop: Cisco Aironet 4800 Access Point with Intelligent Capture
TechWiseTV Workshop: Cisco Aironet 4800 Access Point with Intelligent Capture TechWiseTV Workshop: Cisco Aironet 4800 Access Point with Intelligent Capture
TechWiseTV Workshop: Cisco Aironet 4800 Access Point with Intelligent Capture Robb Boyd
 
Semiconductor Design Services, IoT Solutions, IoT Consulting, IoT Solutions a...
Semiconductor Design Services, IoT Solutions, IoT Consulting, IoT Solutions a...Semiconductor Design Services, IoT Solutions, IoT Consulting, IoT Solutions a...
Semiconductor Design Services, IoT Solutions, IoT Consulting, IoT Solutions a...Moschip
 
TechWiseTV Workshop: Beyond 802.11ac Wave 2
TechWiseTV Workshop: Beyond 802.11ac Wave 2TechWiseTV Workshop: Beyond 802.11ac Wave 2
TechWiseTV Workshop: Beyond 802.11ac Wave 2Robb Boyd
 
Auto id-labs-kaist-research-2014
Auto id-labs-kaist-research-2014Auto id-labs-kaist-research-2014
Auto id-labs-kaist-research-2014Daeyoung Kim
 

Similar to PicoScenes Tutorial @ CPS-IOT Week 2022 (20)

BLE Localiser (Full) for iOS Dev Scout
BLE Localiser (Full) for iOS Dev ScoutBLE Localiser (Full) for iOS Dev Scout
BLE Localiser (Full) for iOS Dev Scout
 
Sergio González - WiFiSlax 4.0 [RootedCON 2010]
Sergio González - WiFiSlax 4.0 [RootedCON 2010]Sergio González - WiFiSlax 4.0 [RootedCON 2010]
Sergio González - WiFiSlax 4.0 [RootedCON 2010]
 
How to Implement SDN Technology in ITB
How to Implement SDN Technology in ITBHow to Implement SDN Technology in ITB
How to Implement SDN Technology in ITB
 
Introduction to Fog
Introduction to FogIntroduction to Fog
Introduction to Fog
 
Cisco Multi-Service FAN Solution
Cisco Multi-Service FAN SolutionCisco Multi-Service FAN Solution
Cisco Multi-Service FAN Solution
 
Implementing AI: Running AI at the Edge: ClickCV – Providing high-performance...
Implementing AI: Running AI at the Edge: ClickCV – Providing high-performance...Implementing AI: Running AI at the Edge: ClickCV – Providing high-performance...
Implementing AI: Running AI at the Edge: ClickCV – Providing high-performance...
 
HiPEAC 2019 Workshop - Hardware Starter Kit Agri
HiPEAC 2019 Workshop - Hardware Starter Kit Agri HiPEAC 2019 Workshop - Hardware Starter Kit Agri
HiPEAC 2019 Workshop - Hardware Starter Kit Agri
 
Join FIWARE Lab
Join FIWARE LabJoin FIWARE Lab
Join FIWARE Lab
 
Practical Core Bluetooth in IoT & Wearable projects @ UIKonf 2016
Practical Core Bluetooth in IoT & Wearable projects @ UIKonf 2016Practical Core Bluetooth in IoT & Wearable projects @ UIKonf 2016
Practical Core Bluetooth in IoT & Wearable projects @ UIKonf 2016
 
Cisco rv110 w wireless n vpn firewall
Cisco rv110 w wireless n vpn firewallCisco rv110 w wireless n vpn firewall
Cisco rv110 w wireless n vpn firewall
 
Network Packet Analysis with Wireshark
Network Packet Analysis with WiresharkNetwork Packet Analysis with Wireshark
Network Packet Analysis with Wireshark
 
MaaXBoard, a single board computer based on NXP i.MX 8M solution for iot appl...
MaaXBoard, a single board computer based on NXP i.MX 8M solution for iot appl...MaaXBoard, a single board computer based on NXP i.MX 8M solution for iot appl...
MaaXBoard, a single board computer based on NXP i.MX 8M solution for iot appl...
 
Sundance at the 49th Intelligent Sensing Program
Sundance at the 49th Intelligent Sensing ProgramSundance at the 49th Intelligent Sensing Program
Sundance at the 49th Intelligent Sensing Program
 
hdl
hdlhdl
hdl
 
Botprobe - Reducing network threat intelligence big data
Botprobe - Reducing network threat intelligence big data Botprobe - Reducing network threat intelligence big data
Botprobe - Reducing network threat intelligence big data
 
TechWiseTV Workshop: Cisco Aironet 4800 Access Point with Intelligent Capture
TechWiseTV Workshop: Cisco Aironet 4800 Access Point with Intelligent Capture TechWiseTV Workshop: Cisco Aironet 4800 Access Point with Intelligent Capture
TechWiseTV Workshop: Cisco Aironet 4800 Access Point with Intelligent Capture
 
Semiconductor Design Services, IoT Solutions, IoT Consulting, IoT Solutions a...
Semiconductor Design Services, IoT Solutions, IoT Consulting, IoT Solutions a...Semiconductor Design Services, IoT Solutions, IoT Consulting, IoT Solutions a...
Semiconductor Design Services, IoT Solutions, IoT Consulting, IoT Solutions a...
 
TechWiseTV Workshop: Beyond 802.11ac Wave 2
TechWiseTV Workshop: Beyond 802.11ac Wave 2TechWiseTV Workshop: Beyond 802.11ac Wave 2
TechWiseTV Workshop: Beyond 802.11ac Wave 2
 
Auto id-labs-kaist-research-2014
Auto id-labs-kaist-research-2014Auto id-labs-kaist-research-2014
Auto id-labs-kaist-research-2014
 
Teksun Corporate Overview 2014
Teksun Corporate Overview 2014Teksun Corporate Overview 2014
Teksun Corporate Overview 2014
 

Recently uploaded

Triploidy ...............................pptx
Triploidy ...............................pptxTriploidy ...............................pptx
Triploidy ...............................pptxCherry
 
Mitosis...............................pptx
Mitosis...............................pptxMitosis...............................pptx
Mitosis...............................pptxCherry
 
Hemoglobin metabolism: C Kalyan & E. Muralinath
Hemoglobin metabolism: C Kalyan & E. MuralinathHemoglobin metabolism: C Kalyan & E. Muralinath
Hemoglobin metabolism: C Kalyan & E. Muralinathmuralinath2
 
Exomoons & Exorings with the Habitable Worlds Observatory I: On the Detection...
Exomoons & Exorings with the Habitable Worlds Observatory I: On the Detection...Exomoons & Exorings with the Habitable Worlds Observatory I: On the Detection...
Exomoons & Exorings with the Habitable Worlds Observatory I: On the Detection...Sérgio Sacani
 
Film Coated Tablet and Film Coating raw materials.pdf
Film Coated Tablet and Film Coating raw materials.pdfFilm Coated Tablet and Film Coating raw materials.pdf
Film Coated Tablet and Film Coating raw materials.pdfPharmatech-rx
 
family therapy psychotherapy types .pdf
family therapy psychotherapy types  .pdffamily therapy psychotherapy types  .pdf
family therapy psychotherapy types .pdfhaseebahmeddrama
 
Aerodynamics. flippatterncn5tm5ttnj6nmnynyppt
Aerodynamics. flippatterncn5tm5ttnj6nmnynypptAerodynamics. flippatterncn5tm5ttnj6nmnynyppt
Aerodynamics. flippatterncn5tm5ttnj6nmnynypptsreddyrahul
 
GBSN - Biochemistry (Unit 4) Chemistry of Carbohydrates
GBSN - Biochemistry (Unit 4) Chemistry of CarbohydratesGBSN - Biochemistry (Unit 4) Chemistry of Carbohydrates
GBSN - Biochemistry (Unit 4) Chemistry of CarbohydratesAreesha Ahmad
 
Pests of Green Manures_Bionomics_IPM_Dr.UPR.pdf
Pests of Green Manures_Bionomics_IPM_Dr.UPR.pdfPests of Green Manures_Bionomics_IPM_Dr.UPR.pdf
Pests of Green Manures_Bionomics_IPM_Dr.UPR.pdfPirithiRaju
 
Constraints on Neutrino Natal Kicks from Black-Hole Binary VFTS 243
Constraints on Neutrino Natal Kicks from Black-Hole Binary VFTS 243Constraints on Neutrino Natal Kicks from Black-Hole Binary VFTS 243
Constraints on Neutrino Natal Kicks from Black-Hole Binary VFTS 243Sérgio Sacani
 
Pests of sugarcane_Binomics_IPM_Dr.UPR.pdf
Pests of sugarcane_Binomics_IPM_Dr.UPR.pdfPests of sugarcane_Binomics_IPM_Dr.UPR.pdf
Pests of sugarcane_Binomics_IPM_Dr.UPR.pdfPirithiRaju
 
GBSN - Microbiology (Unit 7) Microbiology in Everyday Life
GBSN - Microbiology (Unit 7) Microbiology in Everyday LifeGBSN - Microbiology (Unit 7) Microbiology in Everyday Life
GBSN - Microbiology (Unit 7) Microbiology in Everyday LifeAreesha Ahmad
 
In-pond Race way systems for Aquaculture (IPRS).pptx
In-pond Race way systems for Aquaculture (IPRS).pptxIn-pond Race way systems for Aquaculture (IPRS).pptx
In-pond Race way systems for Aquaculture (IPRS).pptxMAGOTI ERNEST
 
Plasmapheresis - Dr. E. Muralinath - Kalyan . C.pptx
Plasmapheresis - Dr. E. Muralinath - Kalyan . C.pptxPlasmapheresis - Dr. E. Muralinath - Kalyan . C.pptx
Plasmapheresis - Dr. E. Muralinath - Kalyan . C.pptxmuralinath2
 
NuGOweek 2024 full programme - hosted by Ghent University
NuGOweek 2024 full programme - hosted by Ghent UniversityNuGOweek 2024 full programme - hosted by Ghent University
NuGOweek 2024 full programme - hosted by Ghent Universitypablovgd
 
Climate extremes likely to drive land mammal extinction during next supercont...
Climate extremes likely to drive land mammal extinction during next supercont...Climate extremes likely to drive land mammal extinction during next supercont...
Climate extremes likely to drive land mammal extinction during next supercont...Sérgio Sacani
 
The solar dynamo begins near the surface
The solar dynamo begins near the surfaceThe solar dynamo begins near the surface
The solar dynamo begins near the surfaceSérgio Sacani
 
GBSN - Microbiology (Unit 6) Human and Microbial interaction
GBSN - Microbiology (Unit 6) Human and Microbial interactionGBSN - Microbiology (Unit 6) Human and Microbial interaction
GBSN - Microbiology (Unit 6) Human and Microbial interactionAreesha Ahmad
 
Continuum emission from within the plunging region of black hole discs
Continuum emission from within the plunging region of black hole discsContinuum emission from within the plunging region of black hole discs
Continuum emission from within the plunging region of black hole discsSérgio Sacani
 
Tuberculosis (TB)-Notes.pdf microbiology notes
Tuberculosis (TB)-Notes.pdf microbiology notesTuberculosis (TB)-Notes.pdf microbiology notes
Tuberculosis (TB)-Notes.pdf microbiology notesjyothisaisri
 

Recently uploaded (20)

Triploidy ...............................pptx
Triploidy ...............................pptxTriploidy ...............................pptx
Triploidy ...............................pptx
 
Mitosis...............................pptx
Mitosis...............................pptxMitosis...............................pptx
Mitosis...............................pptx
 
Hemoglobin metabolism: C Kalyan & E. Muralinath
Hemoglobin metabolism: C Kalyan & E. MuralinathHemoglobin metabolism: C Kalyan & E. Muralinath
Hemoglobin metabolism: C Kalyan & E. Muralinath
 
Exomoons & Exorings with the Habitable Worlds Observatory I: On the Detection...
Exomoons & Exorings with the Habitable Worlds Observatory I: On the Detection...Exomoons & Exorings with the Habitable Worlds Observatory I: On the Detection...
Exomoons & Exorings with the Habitable Worlds Observatory I: On the Detection...
 
Film Coated Tablet and Film Coating raw materials.pdf
Film Coated Tablet and Film Coating raw materials.pdfFilm Coated Tablet and Film Coating raw materials.pdf
Film Coated Tablet and Film Coating raw materials.pdf
 
family therapy psychotherapy types .pdf
family therapy psychotherapy types  .pdffamily therapy psychotherapy types  .pdf
family therapy psychotherapy types .pdf
 
Aerodynamics. flippatterncn5tm5ttnj6nmnynyppt
Aerodynamics. flippatterncn5tm5ttnj6nmnynypptAerodynamics. flippatterncn5tm5ttnj6nmnynyppt
Aerodynamics. flippatterncn5tm5ttnj6nmnynyppt
 
GBSN - Biochemistry (Unit 4) Chemistry of Carbohydrates
GBSN - Biochemistry (Unit 4) Chemistry of CarbohydratesGBSN - Biochemistry (Unit 4) Chemistry of Carbohydrates
GBSN - Biochemistry (Unit 4) Chemistry of Carbohydrates
 
Pests of Green Manures_Bionomics_IPM_Dr.UPR.pdf
Pests of Green Manures_Bionomics_IPM_Dr.UPR.pdfPests of Green Manures_Bionomics_IPM_Dr.UPR.pdf
Pests of Green Manures_Bionomics_IPM_Dr.UPR.pdf
 
Constraints on Neutrino Natal Kicks from Black-Hole Binary VFTS 243
Constraints on Neutrino Natal Kicks from Black-Hole Binary VFTS 243Constraints on Neutrino Natal Kicks from Black-Hole Binary VFTS 243
Constraints on Neutrino Natal Kicks from Black-Hole Binary VFTS 243
 
Pests of sugarcane_Binomics_IPM_Dr.UPR.pdf
Pests of sugarcane_Binomics_IPM_Dr.UPR.pdfPests of sugarcane_Binomics_IPM_Dr.UPR.pdf
Pests of sugarcane_Binomics_IPM_Dr.UPR.pdf
 
GBSN - Microbiology (Unit 7) Microbiology in Everyday Life
GBSN - Microbiology (Unit 7) Microbiology in Everyday LifeGBSN - Microbiology (Unit 7) Microbiology in Everyday Life
GBSN - Microbiology (Unit 7) Microbiology in Everyday Life
 
In-pond Race way systems for Aquaculture (IPRS).pptx
In-pond Race way systems for Aquaculture (IPRS).pptxIn-pond Race way systems for Aquaculture (IPRS).pptx
In-pond Race way systems for Aquaculture (IPRS).pptx
 
Plasmapheresis - Dr. E. Muralinath - Kalyan . C.pptx
Plasmapheresis - Dr. E. Muralinath - Kalyan . C.pptxPlasmapheresis - Dr. E. Muralinath - Kalyan . C.pptx
Plasmapheresis - Dr. E. Muralinath - Kalyan . C.pptx
 
NuGOweek 2024 full programme - hosted by Ghent University
NuGOweek 2024 full programme - hosted by Ghent UniversityNuGOweek 2024 full programme - hosted by Ghent University
NuGOweek 2024 full programme - hosted by Ghent University
 
Climate extremes likely to drive land mammal extinction during next supercont...
Climate extremes likely to drive land mammal extinction during next supercont...Climate extremes likely to drive land mammal extinction during next supercont...
Climate extremes likely to drive land mammal extinction during next supercont...
 
The solar dynamo begins near the surface
The solar dynamo begins near the surfaceThe solar dynamo begins near the surface
The solar dynamo begins near the surface
 
GBSN - Microbiology (Unit 6) Human and Microbial interaction
GBSN - Microbiology (Unit 6) Human and Microbial interactionGBSN - Microbiology (Unit 6) Human and Microbial interaction
GBSN - Microbiology (Unit 6) Human and Microbial interaction
 
Continuum emission from within the plunging region of black hole discs
Continuum emission from within the plunging region of black hole discsContinuum emission from within the plunging region of black hole discs
Continuum emission from within the plunging region of black hole discs
 
Tuberculosis (TB)-Notes.pdf microbiology notes
Tuberculosis (TB)-Notes.pdf microbiology notesTuberculosis (TB)-Notes.pdf microbiology notes
Tuberculosis (TB)-Notes.pdf microbiology notes
 

PicoScenes Tutorial @ CPS-IOT Week 2022

  • 1. https://ps.zpj.io From CSI Tool to PicoScenes Wi-Fi Sensing Middleware Zhiping Jiang, Jun Luo, Zhe Chen 
 School of Computer Science and Technology Xidian University, Xi’an, China Nanyang Technological University, Singapore AIWISE, Guangzhou, China https://ps.zpj.io Supercharging Your Next Wi-Fi Sensing Research
  • 2. https://ps.zpj.io A lecturer with the School of Computer Science and Technology, Xidian University, Xi’an, China. The founder and core developer of PicoScenes Wi-Fi sensing middleware. 2 Dr. Jiang Zhiping (蒋志平)
  • 3. https://ps.zpj.io In the next 40 minutes … •A recap of the current status of Wi-Fi Sensing research (5) •A brief introduction to PicoScenes (15) •Several demo videos (10) •How can researchers bene fi t from PicoScenes? (10) •Q & A 3
  • 4. https://ps.zpj.io Is Wi-Fi sensing still an active research fi eld? 4
  • 5. https://ps.zpj.io Seems not … • Researchers shift to new directions, acoustic, mmWave, LoRa, ZigBee, RFID, CTC, etc. 
 • Methodology: • The model-based papers are extremely hard to get in. • The learning-based approach thrives, but it is not the silver bullet. 5 Why ? The cleverest housewife cannot cook without rice ! 😁 巧妇难为⽆⽶之炊 Is Wi-Fi sensing still an active research fi eld?
  • 6. https://ps.zpj.io Three Barriers in the Wi-Fi sensing research • Unknown baseband design & its in fl uence on CSI • Incapable hardware • Incapable software • No technical support from vendors 6
  • 7. https://ps.zpj.io Three Barriers in the Wi-Fi sensing research: incapable hardware No advanced features • more radio chains • external clock • full-duplex • .... 7 No low-level controls • AGC, calibration • I/Q, PA, • timing, clocking • ... No more PHY layer output • baseband signals • OFDM symbols • CSI by L-LTF • ... Out-of-date • IWL5300/QCA9300/ESP32 based on 802.11n, decade ago; • BCM43xx, 11ac, near a decade SDR ? USRP/ WARP/ RTL-SDR/ LimeSDR ?
  • 8. https://ps.zpj.io Three Barriers in the Wi-Fi sensing research: incapable hardware Ideally, SDR is thought to be the BFG for Wi-Fi sensing… 8 Actually, SDR is rarely used in the Wi- Fi sensing research...
  • 9. https://ps.zpj.io Three Barriers in the Wi-Fi sensing research: incapable hardware 9 COTS NIC too good to abandon? or, SDR hardware too expensive? USRP B210, $ 1,472.00 USD There is no publicly available Wi-Fi baseband implementations. The missing Wi-Fi baseband DSP 0101001000100 ... for SDR
  • 10. https://ps.zpj.io Three Barriers in the Wi-Fi sensing research: incapable software After 10 years, the software is still very primitive ... • No multi-NIC control • No integrated Tx/Rx • No MPDU payload • No hardware control • Deprecated kernel/OS • No collaborative measurement • hard to use, far from maturity • No technical support 10
  • 12. https://ps.zpj.io What is PicoScenes? • Still a CSI tool, but a powerful, modern, easy-to-use, and well-documented one, trying to overcome the hardware and software barriers of Wi-Fi sensing research. • First and temporarily the only Wi-Fi 6E-ready CSI tool • A fl exible Wi-Fi sensing middleware supporting plugin mechanism • Being developed for 5 years, released in Apr. 2021, being used by 58 university / research institutes, 31 in China and 27 oversea • Warmly appreciated by users* • “Thanks again for this software, and I'm looking forward to seeing it develop even further!” — Gleen Forbes (Robert Gordon Univ., UK) • “Thanks for providing an awesome tool” — @wonwon • “Thanks so much for your amazing work putting together PicoScenes! I just discovered it the other week but looks to be a really cool piece of kit, huge congratulations!” — James Bache (Univ. of Exeter, UK) 12 * Comments are excerpted from PicoScenes Issue Tracker. Visit here!
  • 13. https://ps.zpj.io What is PicoScenes? 13 In the hardware aspect… • Supports the most CSI-extractable hardware • Intel AX200 series (AX200/210/211) • Intel 5300 NIC (IWL5300) • Qualcomm Atheros 9300 (QCA9300) • more to support … • Supports SDR into Wi-Fi sensing frontend • USRP series • HackRF One (just over 100$ !) • more to support … • The fi rst and only Wi-Fi 6E-ready CSI Tool • using AX210/211 NIC • 802.11ax + 160-MHz BW + 6-GHz band • 7 continuous 160-MHz channels (5945-7125 MHz) • up to 8192 subcarriers per packet An non-exhaustive list of highlights of PicoScenes… 5.25 5.57 6.025 6.185 6.345 6.505 6.650 6.825 6.985 Carrier Frequency (GHz) 30 40 50 60 Magnitude (dB) 5 GHz Band only 2 160MHz channels 6 GHz Band 7 160 MHz channels 5.95 6 6.05 6.1 Carrier Frequency (GHz) 10 9 40 45 50 Magnitude (dB) Wi-Fi 6E CSI measurement by AX210 Supported HW, including 5 Wi-Fi NICs and SDRs
  • 14. https://ps.zpj.io What is PicoScenes? 14 In the hardware aspect… • Supports the most CSI-extractable hardware • Intel AX200 series (AX200/210/211) • Intel 5300 NIC (IWL5300) • Qualcomm Atheros 9300 (QCA9300) • more to support … • Supports SDR into Wi-Fi sensing frontend • USRP series • HackRF One (just over 100$ !) • more to support … • The fi rst and only Wi-Fi 6E-ready CSI Tool • using AX210/211 NIC • 802.11ax + 160-MHz BW + 6-GHz band • 7 continuous 160-MHz channels (5945-7125 MHz) • up to 8192 subcarriers per packet • Freely turning RF in 2.4-GHz wide spectrum • using QCA9300 NIC • Tunable in 2.2-2.9 and 4.4-6.1 GHz ranges • Up to 200-MHz BW CSI measurement • using USRP X310 SDR • live packet injection & CSI measurement An non-exhaustive list of highlights of PicoScenes… 20-200 MHz BW CSI measurement by X310 QCA9300 supports 2.4-GHz spectrum w/ variable BW
  • 15. https://ps.zpj.io What is PicoScenes? 15 In the software aspect… • Supports multi-frontend CSI measurement • concurrent CSI measurement from heterogeneous HW • Intuitive device naming • Wi-Fi baseband implementation • all-format (a/g/n/ac/ax), up to 4x4 MIMO • Live packet capture & CSI measurement • Signal recording & replay • Packet Injection for all supported frontend • Supports both Wi-Fi NICs and SDR An non-exhaustive list of highlights of PicoScenes… PicoScenes drives a 27-NIC array High-perf. Wi-Fi baseband codec. w/ MIMO support
  • 16. https://ps.zpj.io What is PicoScenes? 16 In the software aspect… • Supports multi-frontend CSI measurement • concurrent CSI measurement from heterogeneous HW • Intuitive device naming • Wi-Fi baseband implementation • all-format (a/g/n/ac/ax), up to 4x4 MIMO • Live packet capture & CSI measurement • Signal recording & replay • Packet Injection for all supported frontend • Supports both Wi-Fi NICs and SDR • Plugin mechanism • Driver + Platform + Plugins architecture • plugins executes all the end-use functionalities • Rapid development for complex & realtime measurement • Provide of fi cial MATLAB/Python Toolbox • Much easier to use • apt-based installation & upgrade on Ubuntu 20.04 • Fresh new installation in 10 mins • The richest documentation An non-exhaustive list of highlights of PicoScenes… PicoScenes supports multi-frontend, and each runs its own plugins NIC 1 COTS or SDR Plug-ins Manager Plug-in n … Plug-in 2 Plug-in 1 Rich documentation
  • 17. https://ps.zpj.io What is PicoScenes? 17 In the software aspect… • Supports multi-frontend CSI measurement • concurrent CSI measurement from heterogeneous HW • Intuitive device naming • Wi-Fi baseband implementation • all-format (a/g/n/ac/ax), up to 4x4 MIMO • Live packet capture & CSI measurement • Signal recording & replay • Packet Injection for all supported frontend • Supports both Wi-Fi NICs and SDR • Plugin mechanism • Driver + Platform + Plugins architecture • plugins executes all the end-use functionalities • Rapid development for complex & realtime measurement • Provide of fi cial MATLAB/Python Toolbox • Much easier to use • apt-based installation & upgrade on Ubuntu 20.04 • Fresh new installation in 10 mins • The richest documentation An non-exhaustive list of highlights of PicoScenes… In the hardware aspect… • Supports the most CSI-extractable hardware • Intel AX200 series (AX200/210/211) • Intel 5300 NIC (IWL5300) • Qualcomm Atheros 9300 (QCA9300) • more to support … • Supports SDR into Wi-Fi sensing frontend • USRP series • HackRF One (just over 100$ !) • more to support … • The fi rst and only Wi-Fi 6E-ready CSI Tool • using AX210/211 NIC • 802.11ax + 160-MHz BW + 6-GHz band • 7 continuous 160-MHz channels (5945-7125 MHz) • up to 8192 subcarriers per packet • Freely turning RF in 2.3-GHz wide spectrum • using QCA9300 NIC • Tunable in 2.2-2.9 and 4.4-6.1 GHz ranges • Up to 200-MHz BW CSI measurement • using USRP X310 SDR • live packet injection & CSI measurement
  • 18. https://ps.zpj.io Demo Videos • CSI measurement between AP and IWL5300/AX200/210 NICs • Fully passive CSI measurement by AX200/AX210 NIC • Packet Injection & CSI measurement between two Wi-Fi NICs • Packet Injection & CSI measurement between two SDRs • 6-GHz spectrum scanning with two AX210 NICs • Installation & Use of PicoScenes MATLAB Toolbox 18
  • 19. https://ps.zpj.io Demo 1: CSI Measurement between AP and AX210 NIC 19
  • 20. https://ps.zpj.io Demo 2: Fully Passive CSI Measurement by AX210 NIC 20
  • 21. https://ps.zpj.io Demo 3: 20/160-MHz BW CSI Measurement between two AX210 NICs 21
  • 22. https://ps.zpj.io Demo 4: CSI Measurement between two SDRs (USRP B210 and HackRF One) 22
  • 23. https://ps.zpj.io Demo 5: CSI Measurement between two SDRs (USRP B210 and HackRF One) 23
  • 24. https://ps.zpj.io Demo 6: CSI measurement while freq- hopping in 6-GHz band using two AX210 24
  • 25. https://ps.zpj.io 25 Demo 7: Installation & Use PicoScenes MATLAB Toolbox PicoScenes MATLAB Toolbox (PMT) provides consistent data parsing and drag’n’drop style .csi fi le decoding.
  • 26. https://ps.zpj.io Powerful & Agile CSI Measurement via PicoScenes Plugin Mechanism
  • 27. https://ps.zpj.io Why plugins? Without plugin architecture, event the simplest CSI measurement tool is a hell, for researchers! 27
  • 28. https://ps.zpj.io Why plugins? Taking random_packets, from Intel 5300 CSI Tool, as an example … 28 random_packets https:// github.com/dhalperi/linux- 80211n-csitool-supplementary/ blob/master/injection/ random_packets: 
 transmit 802.11n-format packets to the special 00:16:ea:12:34:56 MAC address • Total of 190 LoC, 6 sections: 1. headers & constants (20 LoC) 2. packet data structure de fi nition (10 LoC) 3. Program option handling (30 LoC) 4. Packet generation (70 LoC) 5. Initialize packet injection library (20 LoC) 6. Transmit packets (40 LoC) 2 4 3 5 6
  • 29. https://ps.zpj.io Why plugin? Taking log_to_file, from Intel 5300 CSI Tool, as an example … 29 log_to_ fi le https://github.com/dhalperi/linux-80211n- csitool-supplementary/blob/master/netlink/log_to_ fi le.c log_to_ fi le: 
 receive CSI data from driver and dump to disk • Total of 150 LoC, 4 sections: 1. headers & constants (30 LoC) 2. Connect to driver via NetLink (30 LoC) 3. Receive data & dump (50 LoC) 2 3
  • 30. https://ps.zpj.io Powerful & Agile CSI Measurement via PicoScenes Plugin Mechanism Taking “—mode logger”, from PicoScenes EchoProbe plugin, as a comparison … 30 EchoProbe plugin https://gitlab.com/wi fi sensing/PicoScenes-PDK —mode logger of EchoProbe plugin: 
 receive CSI data from driver and dump to disk • Essentially, Just 2 LoC • Grab the frame’s bu ff er • Dump the bu ff er to disk via RXSDumper • Rest of the work, ALL DONE by PicoScenes middleware ! • Communicating with kernel • Receiving the raw bu ff er • Package the bu ff er to ModularPicoScenesRxFrame format • Pass the frame to EchoProbe plugin • etc… Enabling Researchers to prototype their plugins focusing on their CSI measurement task!
  • 31. https://ps.zpj.io Powerful & Agile CSI Measurement via PicoScenes Plugin Mechanism With such simplicity, EchoProbe plugin goes far beyond just a CSI logger… 31 EchoProbe plugin https://gitlab.com/wi fi sensing/PicoScenes-PDK —mode injector of EchoProbe plugin: 
 packet injection using all support frontends • Essentially, Just 3 LoC • Generate frame & specify Tx parameters • Transmit the frames and wait • Wait a while a go next frame • Rest of the work, ALL DONE by PicoScenes middleware ! • generate MPDU bu ff er, • initiate & transmit MPDU bu ff er via COTS NICs • or, generate signal transmit PPDU signal via SDR • etc… 2. Transmit 1. Generate frame & Specify Tx parameters
  • 32. https://ps.zpj.io Powerful & Agile CSI Measurement via PicoScenes Plugin Mechanism With such simplicity, EchoProbe plugin goes far beyond just a CSI logger… 32 EchoProbe plugin https://gitlab.com/wi fi sensing/PicoScenes-PDK —mode responder of EchoProbe plugin: 
 receive packets & transmit them back to initiator • Essentially, Just 50 LoC • Receive RxFrame (CSI and MPDU content) • Generate Reply frames (packet the RxFrame as payload) • Transmit the Reply frames • Rest of the work, ALL DONE by PicoScenes middleware ! • Frame auto segmentation • initiate & transmit MPDU bu ff er via COTS NICs • or, generate signal transmit PPDU signal via SDR • etc… 2. Transmit 1. Generate reply frames
  • 33. https://ps.zpj.io Powerful & Agile CSI Measurement via PicoScenes Plugin Mechanism With such simplicity, EchoProbe plugin goes far beyond just a CSI logger… 33 EchoProbe plugin https://gitlab.com/wi fi sensing/PicoScenes-PDK —mode initiator of EchoProbe plugin: 
 initiate the roundtrip and spectrum scanning CSI measurement with the responder side • Totally, 420 LoC • Handling various Tx/Rx options • EchoProbe Request / FreqChangeRequest generation • Initiator<->Responder ACK-Retry protocol • Frequency and bandwidth scanning protocol • Available Frequency and bandwidth enumeration • Dump the received frames • … • Rest of the work, ALL DONE by PicoScenes middleware ! • Frame auto concatenation • conditional Rx (waiting for Replay frames) and timeout • Communicate with heterogeneous frontend • etc…
  • 34. https://ps.zpj.io Powerful & Agile CSI Measurement via PicoScenes Plugin Mechanism The of fi cial PicoScenes Plugin Development Kit (PicoScenes-PDK) opensources three plugins 34 PicoScenes-PDK https://gitlab.com/wi fi sensing/PicoScenes-PDK PicoScenes-PDK project • Demo Plugin • a rich-documented tutorial plugin • Describe how the plugin communicate with the platform, how to handle RxFrame, • EchoProbe Plugin • 4 modes, injector/logger, initiator/responder • Single/Round-trip CSI measurement • Spectrum scanning CSI measurement • UDP-Forwarder Plugin • Forward received frames to the remove via UDP • Total 50 LoC, the core is just 1 LoC.
  • 36. https://ps.zpj.io 36 PicoScenes Architecture PicoScenes project roots and initiated upon the customized drivers for QCA9300, IWL5300, and AX200/210/211NICs. Customized DVM Driver Customized Ath9k Driver Customized MVM Driver Customized NIC Driver / SDR Driver COTS Wi-Fi NICs / SDR Customized DVM Driver Customized Ath9k Driver Customized MVM Driver Customized NIC Driver / SDR Driver COTS Wi-Fi NICs / SDR
  • 37. https://ps.zpj.io 37 PicoScenes Architecture Customized DVM Driver Customized Ath9k Driver Customized MVM Driver Customized NIC Driver / SDR Driver COTS Wi-Fi NICs / SDR for AX200/210/211 for QCA9300 • Wi-Fi 6E-ready CSI measurement *1 • Unlock the 6-GHz band for AX210/211 • All-format CSI measurement (802.11a/g/n/ac/ax) • Up to 160-MHz bandwidth (1992 subcarriers per-stream) • Fully passive CSI measurement for all overheard frames *2 • Packet injection in all format • Arbitrary carrier freq. tuning (2.2-2.9 and 4.4-6.1 GHz) • Arbitrary sampling rate tuning (2.5 to 80 MHz) • Manual Rx-Gain • Extra Spatial Sounding (ESS) * Wi-Fi 6E = 11ax + 160MHz BW + 6 GHz band * CSI measurement in monitor mode supports all formats and all coding (BCC, LDPC) for all supported NICs • Simultaneous multi-NIC CSI measurement • Rich output, MPDU (packet) content + CSI + various HW status • Uni fi ed data format with backward compatibility • O ff er common HW settings, e.g., Tx/Rx radio chain selection, Tx power PicoScenes project roots and initiated upon the customized drivers for QCA9300, IWL5300, and AX200/210/211NICs. Some highlights are …
  • 38. https://ps.zpj.io 38 PicoScenes Architecture PicoScenes platform encapsulates the low-level controls into a hierarchy of AbstractFrontEnd (API). QCA9300 Frontend Intel Abstract Frontend Abstract COTS NIC Frontend Customized DVM Driver Customized Ath9k Driver Customized MVM Driver Customized NIC Driver / SDR Driver COTS Wi-Fi NICs / SDR IWL5300 Frontend AX200/210/211 Frontend Customized DVM Driver Customized Ath9k Driver Customized MVM Driver Customized NIC Driver / SDR Driver COTS Wi-Fi NICs / SDR
  • 39. https://ps.zpj.io 39 PicoScenes Architecture PicoScenes platform encapsulates the low-level controls into a hierarchy of AbstractFrontEnd (API). It offers … QCA9300 Frontend Intel Abstract Frontend Abstract COTS NIC Frontend Customized DVM Driver Customized Ath9k Driver Customized MVM Driver Customized NIC Driver / SDR Driver COTS Wi-Fi NICs / SDR IWL5300 Frontend AX200/210/211 Frontend HW-neutral APIs to • Transmit packets • Receive packets • Receive CSI measurement • query HW status • access various settings • channel • bandwidth • carrier frequency • sampling rate • Tx parameters • Tx/Rx gain • Tx/Rx chain mask • …
  • 40. https://ps.zpj.io 40 PicoScenes Architecture Based on our Wi-Fi baseband implementation, PicoScenes supports various SDR frontend, and encapsulates them by AbstractSDRFrontEnd API. QCA9300 Frontend Intel Abstract Frontend Abstract COTS NIC Frontend Customized DVM Driver Customized Ath9k Driver Customized MVM Driver Customized NIC Driver / SDR Driver COTS Wi-Fi NICs / SDR IWL5300 Frontend AX200/210/211 Frontend QCA9300 Frontend Intel Abstract Frontend Abstract SDR Frontend Abstract COTS NIC Frontend USRP Frontend SoapySDR based FrontEnd 802.11a/g/n/ac/ /ax Baseband Impl. UHD Driver SoapySDR w/ various drivers Customized DVM Driver Customized Ath9k Driver Customized MVM Driver Customized NIC Driver / SDR Driver COTS Wi-Fi NICs / SDR IWL5300 Frontend AX200/210/211 Frontend Abstract FrontEnd API
  • 41. https://ps.zpj.io 41 PicoScenes Architecture HW-neutral APIs to • Transmit & receive packets • Access Full PHY decoding results • Multi-stage CSI • Legacy CSI (L-LTF) • CSI (HT/VHT/HE-LTF) • Pilot CSI (Pilot subcarriers per OFDM symbol) • CFO & SFO estimation • Raw baseband signal • etc… • Complete Control over Tx/Rx PHY • Carrier frequency • Sampling rate • Antenna control • Tx/Rx gain • Tx/Rx chain mask • Time/Clock sync. • Precoding / beamforming • Over/down-sampling • etc… QCA9300 Frontend Intel Abstract Frontend Abstract SDR Frontend Abstract COTS NIC Frontend USRP Frontend SoapySDR based FrontEnd 802.11a/g/n/ac/ /ax Baseband Impl. UHD Driver SoapySDR w/ various drivers Customized DVM Driver Customized Ath9k Driver Customized MVM Driver Customized NIC Driver / SDR Driver COTS Wi-Fi NICs / SDR IWL5300 Frontend AX200/210/211 Frontend Abstract FrontEnd API Based on our Wi-Fi baseband implementation, PicoScenes supports various SDR frontend, and encapsulates them by AbstractSDRFrontEnd API, which offers…
  • 42. https://ps.zpj.io 42 PicoScenes Architecture QCA9300 Frontend Intel Abstract Frontend Abstract COTS NIC Frontend Customized DVM Driver Customized Ath9k Driver Customized MVM Driver Customized NIC Driver / SDR Driver COTS Wi-Fi NICs / SDR IWL5300 Frontend AX200/210/211 Frontend QCA9300 Frontend Intel Abstract Frontend Abstract SDR Frontend Abstract COTS NIC Frontend USRP Frontend SoapySDR based FrontEnd 802.11a/g/n/ac/ /ax Baseband Impl. UHD Driver SoapySDR w/ various drivers Customized DVM Driver Customized Ath9k Driver Customized MVM Driver Customized NIC Driver / SDR Driver COTS Wi-Fi NICs / SDR IWL5300 Frontend AX200/210/211 Frontend Abstract FrontEnd API NIC 1 COTS or SDR QCA9300 Frontend Intel Abstract Frontend Abstract SDR Frontend Abstract COTS NIC Frontend USRP Frontend SoapySDR based FrontEnd 802.11a/g/n/ac/ /ax Baseband Impl. UHD Driver SoapySDR w/ various drivers Customized DVM Driver Customized Ath9k Driver NIC 2 COTS or SDR NIC m COTS or SDR … Customized MVM Driver NIC 3 COTS or SDR PicoScenes Platform Customized NIC Driver / SDR Driver COTS Wi-Fi NICs / SDR Unified NIC (AbstractNIC API) IWL5300 Frontend AX200/210/211 Frontend Abstract FrontEnd API We add another layer of abstraction, AbstractNIC.
  • 43. https://ps.zpj.io 43 PicoScenes Architecture NIC 1 COTS or SDR QCA9300 Frontend Intel Abstract Frontend Abstract SDR Frontend Abstract COTS NIC Frontend USRP Frontend SoapySDR based FrontEnd 802.11a/g/n/ac/ /ax Baseband Impl. UHD Driver SoapySDR w/ various drivers Customized DVM Driver Customized Ath9k Driver NIC 2 COTS or SDR NIC m COTS or SDR … Customized MVM Driver NIC 3 COTS or SDR PicoScenes Platform Customized NIC Driver / SDR Driver COTS Wi-Fi NICs / SDR Unified NIC (AbstractNIC API) IWL5300 Frontend AX200/210/211 Frontend Abstract FrontEnd API HW-neutral APIs to • Multi-frontend concurrency • Uni fi cation for heterogeneous HW • Tx & Rx queue control • Timed batch Tx • Signal generation • Conditional Rx for • certain formats … • certain type … • arbitrary criteria • CLI option parsing • etc… We add another layer of abstraction, AbstractNIC. It offers …
  • 44. https://ps.zpj.io 44 PicoScenes Architecture Each AbstractNIC has its own Plugin Manager, which hosts and executes the atop PicoScenes plugin layer. NIC 1 COTS or SDR QCA9300 Frontend Intel Abstract Frontend Abstract SDR Frontend Abstract COTS NIC Frontend USRP Frontend SoapySDR based FrontEnd 802.11a/g/n/ac/ /ax Baseband Impl. UHD Driver SoapySDR w/ various drivers Customized DVM Driver Customized Ath9k Driver Plug-ins Manager NIC 2 COTS or SDR NIC m COTS or SDR … Plug-ins Manager Plug-ins Manager Plug-in n … Plug-in 2 Plug-in 1 Plug-in n … Plug-in 2 Plug-in 1 Plug-in n … Plug-in 2 Plug-in 1 Control & Data Flow Customized MVM Driver NIC 3 COTS or SDR Plug-ins Manager Plug-in n … Plug-in 2 Plug-in 1 PicoScenes Application Plugins PicoScenes Platform Customized NIC Driver / SDR Driver COTS Wi-Fi NICs / SDR Unified NIC (AbstractNIC API) IWL5300 Frontend AX200/210/211 Frontend Abstract FrontEnd API NIC 1 COTS or SDR QCA9300 Frontend Intel Abstract Frontend Abstract SDR Frontend Abstract COTS NIC Frontend USRP Frontend SoapySDR based FrontEnd 802.11a/g/n/ac/ /ax Baseband Impl. UHD Driver SoapySDR w/ various drivers Customized DVM Driver Customized Ath9k Driver NIC 2 COTS or SDR NIC m COTS or SDR … Customized MVM Driver NIC 3 COTS or SDR PicoScenes Platform Customized NIC Driver / SDR Driver COTS Wi-Fi NICs / SDR Unified NIC (AbstractNIC API) IWL5300 Frontend AX200/210/211 Frontend Abstract FrontEnd API
  • 45. https://ps.zpj.io 45 PicoScenes Architecture Each AbstractNIC has its own Plugin Manager, which hosts and executes the atop PicoScenes plugin layer. This architecture offers … HW-neutral APIs to • CSI measurement middleware mechanism • Extensibility & scalability • Plugin isolation & concurrency • Implementing enduser functionalities • CSI dump to disk • packet injection • CSI data UDP forwarding • Round-trip CSI measurement • Freq. hopping CSI measurement • etc… NIC 1 COTS or SDR QCA9300 Frontend Intel Abstract Frontend Abstract SDR Frontend Abstract COTS NIC Frontend USRP Frontend SoapySDR based FrontEnd 802.11a/g/n/ac/ /ax Baseband Impl. UHD Driver SoapySDR w/ various drivers Customized DVM Driver Customized Ath9k Driver Plug-ins Manager NIC 2 COTS or SDR NIC m COTS or SDR … Plug-ins Manager Plug-ins Manager Plug-in n … Plug-in 2 Plug-in 1 Plug-in n … Plug-in 2 Plug-in 1 Plug-in n … Plug-in 2 Plug-in 1 Control & Data Flow Customized MVM Driver NIC 3 COTS or SDR Plug-ins Manager Plug-in n … Plug-in 2 Plug-in 1 PicoScenes Application Plugins PicoScenes Platform Customized NIC Driver / SDR Driver COTS Wi-Fi NICs / SDR Unified NIC (AbstractNIC API) IWL5300 Frontend AX200/210/211 Frontend Abstract FrontEnd API
  • 46. https://ps.zpj.io 46 PicoScenes Architecture Each AbstractNIC has its own Plugin Manager, which hosts and executes the atop PicoScenes plugin layer. This architecture offers … HW-neutral APIs to • CSI measurement middleware mechanism • Extensibility & scalability • Plugin isolation & concurrency • Implementing enduser functionalities • CSI dump to disk • packet injection • CSI data UDP forwarding • Round-trip CSI measurement • Freq. hopping CSI measurement • etc… NIC 1 COTS or SDR QCA9300 Frontend Intel Abstract Frontend Abstract SDR Frontend Abstract COTS NIC Frontend USRP Frontend SoapySDR based FrontEnd 802.11a/g/n/ac/ /ax Baseband Impl. UHD Driver SoapySDR w/ various drivers Customized DVM Driver Customized Ath9k Driver Plug-ins Manager NIC 2 COTS or SDR NIC m COTS or SDR … Plug-ins Manager Plug-ins Manager Plug-in n … Plug-in 2 Plug-in 1 Plug-in n … Plug-in 2 Plug-in 1 Plug-in n … Plug-in 2 Plug-in 1 Control & Data Flow Customized MVM Driver NIC 3 COTS or SDR Plug-ins Manager Plug-in n … Plug-in 2 Plug-in 1 PicoScenes Application Plugins PicoScenes Platform Customized NIC Driver / SDR Driver COTS Wi-Fi NICs / SDR Unified NIC (AbstractNIC API) IWL5300 Frontend AX200/210/211 Frontend Abstract FrontEnd API NIC 1 COTS or SDR QCA9300 Frontend Intel Abstract Frontend Abstract SDR Frontend Abstract COTS NIC Frontend USRP Frontend SoapySDR based FrontEnd 802.11a/g/n/ac/ /ax Baseband Impl. UHD Driver SoapySDR w/ various drivers Customized DVM Driver Customized Ath9k Driver Plug-ins Manager NIC 2 COTS or SDR NIC m COTS or SDR … Plug-ins Manager Plug-ins Manager Plug-in n … Plug-in 2 Plug-in 1 Plug-in n … Plug-in 2 Plug-in 1 Plug-in n … Plug-in 2 Plug-in 1 Control & Data Flow Customized MVM Driver NIC 3 COTS or SDR Plug-ins Manager Plug-in n … Plug-in 2 Plug-in 1 PicoScenes Application Plugins PicoScenes Platform Customized NIC Driver / SDR Driver COTS Wi-Fi NICs / SDR Unified NIC (AbstractNIC API) IWL5300 Frontend AX200/210/211 Frontend Abstract FrontEnd API
  • 47. https://ps.zpj.io 47 PicoScenes Architecture Abstract SDR Frontend USRP Frontend SoapySDR based FrontEnd 802.11a/g/n/ac/ /ax Baseband Impl. UHD Driver SoapySDR w/ various drivers NIC m COTS or SDR … Plug-ins Manager Plug-in n … Plug-in 2 Plug-in 1 Control & Data Flow omized Driver NIC 3 S or SDR lug-ins anager Plug-in n … Plug-in 2 ug-in 1 SDR Driver (Rx Path) Coarse Packet Detection Fine Packet Detection Coarse CFO Estimation Fine CFO Estimation CFO Compensation Legacy Channel Estimation (L-LTF) Format Detection (11a/g/n/ac/ax) Baseband Signal Buffer SIG-Field Decoding (Non- HT/HT/VHT/HE) BCC/LDPC Data Symbol Decoding Channel Estimation (HT/ VHT/HE-LTF) Rx Report (Rx packet, CSI, CFO, SFO, pre-EQ symbols, EVM, scramble, raw signals, Tx Parameters, etc.) SDR Driver (Tx Path) Inter-Symbol Windowing Add CSD, Symbol Concat. Legacy Preamble (L-STF, L-LTF, L- SIG) in Time Domain HT/VHT/HE Preamble (HT/VHT/ HE- STF/LTF/SIG) in Time Domain Data Symbols in Time Domain Data BCC/LDPC Encoding Scrambler + Interleaving IFFT + Cyclic Prefix Insertion IFFT + Cyclic Prefix Insertion IFFT + Cyclic Prefix Insertion Legacy Preamble (L-STF, L-LTF, L- SIG) HT/VHT/HE Preamble Tx Parameters (Tx data bits, format, MCS, coding, BW, precoding, multiuser configuration, scrambler, etc.) Data Flow 1 2 3 Tx Rx Signal Generation Coordinator 1 2 3 802.11 a/g/n/ac/ax Software Baseband Implementation with 4x4 MIMO Support /210/211 ntend Precoding/ Beamforming stract End API MAC Frame Parsing Packaging Decoding Results
  • 48. https://ps.zpj.io 48 PicoScenes Architecture NIC 1 COTS or SDR QCA9300 Frontend Intel Abstract Frontend Abstract SDR Frontend Abstract COTS NIC Frontend USRP Frontend SoapySDR based FrontEnd 802.11a/g/n/ac/ /ax Baseband Impl. UHD Driver SoapySDR w/ various drivers Customized DVM Driver Customized Ath9k Driver Plug-ins Manager NIC 2 COTS or SDR NIC m COTS or SDR … Plug-ins Manager Plug-ins Manager Plug-in n … Plug-in 2 Plug-in 1 Plug-in n … Plug-in 2 Plug-in 1 Plug-in n … Plug-in 2 Plug-in 1 Control & Data Flow Customized MVM Driver NIC 3 COTS or SDR Plug-ins Manager Plug-in n … Plug-in 2 Plug-in 1 PicoScenes Application Plugins PicoScenes Platform Customized NIC Driver / SDR Driver COTS Wi-Fi NICs / SDR SDR Driver (Rx Path) Coarse Packet Detection Fine Packet Detection Coarse CFO Estimation Fine CFO Estimation CFO Compensation Legacy Channel Estimation (L-LTF) Format Detection (11a/g/n/ac/ax) Baseband Signal Buffer SIG-Field Decoding (Non- HT/HT/VHT/HE) BCC/LDPC Data Symbol Decoding Channel Estimation (HT/ VHT/HE-LTF) Rx Report (Rx packet, CSI, CFO, SFO, pre-EQ symbols, EVM, scramble, raw signals, Tx Parameters, etc.) SDR Driver (Tx Path) Inter-Symbol Windowing Add CSD, Symbol Concat. Legacy Preamble (L-STF, L-LTF, L- SIG) in Time Domain HT/VHT/HE Preamble (HT/VHT/ HE- STF/LTF/SIG) in Time Domain Data Symbols in Time Domain Data BCC/LDPC Encoding Scrambler + Interleaving IFFT + Cyclic Prefix Insertion IFFT + Cyclic Prefix Insertion IFFT + Cyclic Prefix Insertion Legacy Preamble (L-STF, L-LTF, L- SIG) HT/VHT/HE Preamble Tx Parameters (Tx data bits, format, MCS, coding, BW, precoding, multiuser configuration, scrambler, etc.) Data Flow 1 2 3 Tx Rx Signal Generation Coordinator 1 2 3 Unified NIC (AbstractNIC API) 802.11 a/g/n/ac/ax Software Baseband Implementation with 4x4 MIMO Support IWL5300 Frontend AX200/210/211 Frontend Precoding/ Beamforming Abstract FrontEnd API MAC Frame Parsing Packaging Decoding Results PicoScnees Wi-Fi baseband Implementation • Transform SDR into a Wi-Fi NIC, live decoding & packet injection • Full compliance with 802.11a/g/n/ac/ax standard • Cover most advanced features, e.g., all-format, all-bandwidth (20/40/80/160-MHz), all-codec (BCC/LDPC), all-MCS (0-11), precoding, beamforming, and up to 4x4 MIMO. • Full control & access to PHY • High-performance, decoding in realtime with 0 packet loss in 20/40-MHz bandwidth
  • 49. https://ps.zpj.io How PicoScenes can supercharge your next Wi- Fi sensing research?
  • 50. https://ps.zpj.io New Opportunities Provided by PicoScenes 50 In the hardware aspect… • “Wi-Fi 6E” titled Wi-Fi sensing research • Ultra-bandwidth (UWB) on Wi-Fi • 160-MHz BW + 6-GHz band (7 x 160-MHz channels) • Challenges: Channel stitching? • 11ax-format, up to 8192 subcarriers per measurement • Fully passive Wi-Fi sensing, enhanced by Wi-Fi 6E • A game changing paradigm for device-free Wi-Fi sensing • Transforming surrounding signals into excitations! • Challenges: transient signals (spatial and temporal) • Wi-Fi sensing in unlicensed spectrum • Powered by QCA9300 and SDR • QCA9300: 2.2-2.9 and 4.4-6.1 GHz • USRP: 10-6000 MHz • HackRF One 10-7250 MHz • Much wider and clean spectrum Spectrum stitching after CSI distortion removal 5.25 5.57 6.025 6.185 6.345 6.505 6.650 6.825 6.985 Carrier Frequency (GHz) 30 40 50 60 Magnitude (dB) 5 GHz Band only 2 160MHz channels 6 GHz Band 7 160 MHz channels 5.95 6 6.05 6.1 Carrier Frequency (GHz) 109 40 45 50 Magnitude (dB) All 9 160-MHz BW channels in 5&6-GHz
  • 51. https://ps.zpj.io New Opportunities Provided by PicoScenes 51 In the software aspect… • Concurrent multi-frontend CSI measurement • Unlock the path to phased array • High-Wi-Fi baseband implementation & integration • Signal generation • Fully controlled Tx/Rx PHY • Integrated packet injection w/ all-format support • Arbitrary content injection • Security research • Precise Timing (both Tx and Rx) • precisely timed batch Tx (by SDR) • ADC-level Rx timestamp (AX200/210 and SDR) • Much easier & larger-scale CSI measurement in spatial, temporal, and spectrum. • Complex & interactive CSI measurement now possible! • Example code, EchoProbe initiator <-> responder AX210-based Wi-Fi NIC array Wire-free CFO estimation & elimination
  • 52. https://ps.zpj.io New Opportunities Provided by PicoScenes 52 In the software aspect… • Concurrent multi-frontend CSI measurement • Unlock the path to phased array • High-Wi-Fi baseband implementation & integration • Signal generation • Fully controlled Tx/Rx PHY • Integrated packet injection w/ all-format support • Arbitrary content injection • Security research • Precise Timing (both Tx and Rx) • precisely timed batch Tx (by SDR) • ADC-level Rx timestamp (AX200/210 and SDR) • Much easier & larger-scale CSI measurement in spatial, temporal, and spectrum. • Complex & interactive CSI measurement now possible! • Example code, EchoProbe initiator <-> responder In the hardware aspect… • “Wi-Fi 6E” titled Wi-Fi sensing research • Ultra-bandwidth (UWB) on Wi-Fi • 160-MHz BW + 6-GHz band (7 x 160-MHz channels) • Challenges: Channel stitching? • 11ax-format, up to 8192 subcarriers per measurement • Fully passive Wi-Fi sensing, enhanced by Wi-Fi 6E • A game changing paradigm for device-free Wi-Fi sensing • Transforming surrounding signals into excitations! • Challenges: transient signals (spatial and temporal) • Wi-Fi sensing in unlicensed spectrum • Powered by QCA9300 and SDR • QCA9300: 2.2-2.9 and 4.4-6.1 GHz • USRP: 10-6000 MHz • HackRF One 10-7250 MHz • Much wider and clean spectrum
  • 53. https://ps.zpj.io Resources • “Eliminating the Barriers: Demystifying Wi-Fi Baseband Design and Introducing the PicoScenes Wi-Fi Sensing Platform”, Zhiping Jiang, et.al, IEEE Internet of Things Journal, 2021, https://doi.org/10.1109/JIOT.2021.3104666 • PicoScenes software documents: https://ps.zpj.io • PicoScenes Issue Tracker (all issues go here!) https://gitlab.com/wi fi sensing/ picoscenes-issue-tracker • Opensource subprojects • RXS-Parsing-Core Library https://gitlab.com/wi fi sensing/rxs_parsing_core • PicoScenes Plugin Development Kit (PDK) https://gitlab.com/wi fi sensing/PicoScenes-PDK • PicoScenes MATLAB Toolbox Core (PMT-Core) https://gitlab.com/wi fi sensing/PicoScenes-MATLAB- Toolbox-Core • PicoScenes Python Toolbox Core (PPT-Core) https://gitlab.com/wi fi sensing/PicoScenes-Python- Toolbox 53
  • 56. https://ps.zpj.io Wi-Fi Sensing CSI Tools (pre PicoScenes) 56 CSI Tools based on COTS Wi-Fi NICs Hardware Release Year Released Tool Highest
 Standard Highlight Features Citation Count Intel 5300 NIC 2011 Intel 5300 CSI Tool 802.11n First CSI tool, 3T3R, 8-bit ADC >1000 Atheros 
 9300 NIC 2015 Atheros CSI Tool 802.11n 10-bit ADC, 3T3R, full subcarriers (56/114) >100 Broadcom 43xx Chip 2019 Nexmon CSI Extractor 802.11ac First 11ac CSI tool, up to 4T4R on modi fi ed router <100 ESP 32 2020 Wi-ESP 802.11n Ultra low-cost SoC, standalone, 1T1R >10 CSI Tools based on General SDR / ZynQ Hardware Release Year Baseband Implementation Highlight Features Cost Citation Count USRP 2008 none is public available widely accepted by academic, easy for synchronization $1100 - 25000 >100 WARP v3 2012 PHY/MAC on ZynQ Full PHY + MAC layer Enquiry >10 Open Wi-Fi 2019 PHY/MAC on ZynQ Full opensource, FPGA-based Wi-Fi NIC $500 - 10000 ~10
  • 57. https://ps.zpj.io PicoScenes Data Production & Consumption CSI data production & consumption in PicoScenes ecosystem 57 RXS-Parsing-Core Library (Common C++ data structure & parsing, preprocessing routine) PicoScenes Platform PicoScenes Modified NIC Drivers PicoScenes Plugins PicoScenes Baseband Implementation Data Producers Data Consumer Matrix PicoScenes MATLAB Toolbox Core (PMT-Core) PicoScenes Python Toolbox Core (PPT- Core) User developed Wi-Fi Sensing App (realtime) In-plugin CSI data processing PicoScenes built-in CSI Live Plotter User developed CSI processing library (offline) Rx in PicoScenesModularRxFrame Tx in PicoScenesModularTxFrame Rx in PicoScenesModularRxFrame Tx in PicoScenesModularTxFrame Available channels: in-app exchange remote UDP offline .csi file data packaging & unpacking data packaging & unpacking common data structure RXS-Parsing-Core Library https://gitlab.com/wi fi sensing/rxs_parsing_core PicoScenes Plugin Development Kit (PDK) https://gitlab.com/wi fi sensing/PicoScenes-PDK PicoScenes MATLAB Toolbox Core (PMT-Core) https://gitlab.com/wi fi sensing/PicoScenes-MATLAB-Toolbox-Core PicoScenes Python Toolbox Core (PPT-Core) https://gitlab.com/wi fi sensing/PicoScenes-Python-Toolbox