Why Operations Support Systems (OSS) Are Not the Answer to All? Enhanced Network Performance Evaluation with Mobile Probes", Leonid Semakov, Product Engineer, Rohde & Schwarz, Germany
UPM601-C Ultra High Frequency Partial Discharge Monitor | Rugged Monitoringrugged_monitoring
The Portable Ultra-High Frequency Partial Discharge (PD) Monitor allows high-voltage asset owners to continuously monitor insulation defects. It can also conduct offline PD measurements during high-voltage AC testing. The compact and rugged design of this portable monitor facilitates easy installation and initiation. The system can communicate with users through IEC61850 or the proprietary Rugged Enterprise/RM EYE software suite from Rugged Monitoring. Its simple design allows seamless interfacing with third-party protocols.
Read more : https://bit.ly/49qvp61
This presentation covers an industry perspective and a roadmap towards 5G with open and democratized interfaces. It covers examples of open reference platforms and how open source communities can complement standard bodies such as 3GPP and IEEE. It characterizes RAN and user and control plane core micro services and discusses opportunities for embedded network telemetry for emerging machine learning applications.
Speaker: Tom Tofigh, Principal Member of Technical Staff (Architect) at AT&T
#Interactive Session by Pradipta Biswas and Sucheta Saurabh Chitale, "Navigat...Agile Testing Alliance
#Interactive Session by Pradipta Biswas and Sucheta Saurabh Chitale, "Navigating the IoT Performance Testing Landscape" at #ATAGTR2023.
#ATAGTR2023 was the 8th Edition of Global Testing Retreat.
To know more about #ATAGTR2023, please visit: https://gtr.agiletestingalliance.org/
For RF Optimisation and neighbour verification both Scanner and UE measurements are required simultaneously
Post-Processing tool is required for data analysis
Individual call failures or drops can be analysed with Drive test tools (e.g. Nemo Outdoor) but to get bigger picture, a proper analysis tool is required
Actix or Nemo Analyser can be used for
Data analysis
Create Maps
Create KPI reports
Similar to Leonid Semakov presentation Enhanced Network Performance Evaluation (20)
Communications Regulatory Agency, Bosnia and HerzegovinaAlexMinov
"Benchmarking of Emerging Technologies and Applications, Internet Related Performance Measurements in Bosnia and Herzegovina", Irma Sokolović, Senior Expert in Radio Monitoring Department [ Biography ] and Mia Petrović, Senior Expert, Division of Control of Compliance with License Terms and Conditions, Communications Regulatory Agency, Bosnia and Herzegovina
"BERECs Network Neutrality Measurement Methodology, and how it supports the EU’s “Open Internet” regulation 2015/2120 (AKA Net Neutrality)", Mick Fox, Drafter, BEREC Open Internet EWG, Ireland
"Approaches being taken in OECD Countries to Measure Broadband Performance", Martin Brand, Q9/11 Rapporteur, Technology, Fixed Voice & Signalling, A1 Telekom Austria , Austria
"Approaches being taken in OECD Countries to Measure Broadband Performance", Martin Brand, Q9/11 Rapporteur, Technology, Fixed Voice & Signalling, A1 Telekom Austria , Austria
"Approaches being taken in OECD Countries to Measure Broadband Performance", Martin Brand, Q9/11 Rapporteur, Technology, Fixed Voice & Signalling, A1 Telekom Austria , Austria
BERECs Network Neutrality Measurement Methodology, and how it supports the EU...AlexMinov
"BERECs Network Neutrality Measurement Methodology, and how it supports the EU’s “Open Internet” regulation 2015/2120 (AKA Net Neutrality)", Mick Fox, Drafter, BEREC Open Internet EWG, Ireland
Why Operations Support Systems (OSS) Are Not the Answer to All? Enhanced Network Performance Evaluation with Mobile Probes", Leonid Semakov, Product Engineer, Rohde & Schwarz, Germany
Accelerate your Kubernetes clusters with Varnish CachingThijs Feryn
A presentation about the usage and availability of Varnish on Kubernetes. This talk explores the capabilities of Varnish caching and shows how to use the Varnish Helm chart to deploy it to Kubernetes.
This presentation was delivered at K8SUG Singapore. See https://feryn.eu/presentations/accelerate-your-kubernetes-clusters-with-varnish-caching-k8sug-singapore-28-2024 for more details.
Elevating Tactical DDD Patterns Through Object CalisthenicsDorra BARTAGUIZ
After immersing yourself in the blue book and its red counterpart, attending DDD-focused conferences, and applying tactical patterns, you're left with a crucial question: How do I ensure my design is effective? Tactical patterns within Domain-Driven Design (DDD) serve as guiding principles for creating clear and manageable domain models. However, achieving success with these patterns requires additional guidance. Interestingly, we've observed that a set of constraints initially designed for training purposes remarkably aligns with effective pattern implementation, offering a more ‘mechanical’ approach. Let's explore together how Object Calisthenics can elevate the design of your tactical DDD patterns, offering concrete help for those venturing into DDD for the first time!
Epistemic Interaction - tuning interfaces to provide information for AI supportAlan Dix
Paper presented at SYNERGY workshop at AVI 2024, Genoa, Italy. 3rd June 2024
https://alandix.com/academic/papers/synergy2024-epistemic/
As machine learning integrates deeper into human-computer interactions, the concept of epistemic interaction emerges, aiming to refine these interactions to enhance system adaptability. This approach encourages minor, intentional adjustments in user behaviour to enrich the data available for system learning. This paper introduces epistemic interaction within the context of human-system communication, illustrating how deliberate interaction design can improve system understanding and adaptation. Through concrete examples, we demonstrate the potential of epistemic interaction to significantly advance human-computer interaction by leveraging intuitive human communication strategies to inform system design and functionality, offering a novel pathway for enriching user-system engagements.
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...UiPathCommunity
💥 Speed, accuracy, and scaling – discover the superpowers of GenAI in action with UiPath Document Understanding and Communications Mining™:
See how to accelerate model training and optimize model performance with active learning
Learn about the latest enhancements to out-of-the-box document processing – with little to no training required
Get an exclusive demo of the new family of UiPath LLMs – GenAI models specialized for processing different types of documents and messages
This is a hands-on session specifically designed for automation developers and AI enthusiasts seeking to enhance their knowledge in leveraging the latest intelligent document processing capabilities offered by UiPath.
Speakers:
👨🏫 Andras Palfi, Senior Product Manager, UiPath
👩🏫 Lenka Dulovicova, Product Program Manager, UiPath
GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...James Anderson
Effective Application Security in Software Delivery lifecycle using Deployment Firewall and DBOM
The modern software delivery process (or the CI/CD process) includes many tools, distributed teams, open-source code, and cloud platforms. Constant focus on speed to release software to market, along with the traditional slow and manual security checks has caused gaps in continuous security as an important piece in the software supply chain. Today organizations feel more susceptible to external and internal cyber threats due to the vast attack surface in their applications supply chain and the lack of end-to-end governance and risk management.
The software team must secure its software delivery process to avoid vulnerability and security breaches. This needs to be achieved with existing tool chains and without extensive rework of the delivery processes. This talk will present strategies and techniques for providing visibility into the true risk of the existing vulnerabilities, preventing the introduction of security issues in the software, resolving vulnerabilities in production environments quickly, and capturing the deployment bill of materials (DBOM).
Speakers:
Bob Boule
Robert Boule is a technology enthusiast with PASSION for technology and making things work along with a knack for helping others understand how things work. He comes with around 20 years of solution engineering experience in application security, software continuous delivery, and SaaS platforms. He is known for his dynamic presentations in CI/CD and application security integrated in software delivery lifecycle.
Gopinath Rebala
Gopinath Rebala is the CTO of OpsMx, where he has overall responsibility for the machine learning and data processing architectures for Secure Software Delivery. Gopi also has a strong connection with our customers, leading design and architecture for strategic implementations. Gopi is a frequent speaker and well-known leader in continuous delivery and integrating security into software delivery.
Key Trends Shaping the Future of Infrastructure.pdfCheryl Hung
Keynote at DIGIT West Expo, Glasgow on 29 May 2024.
Cheryl Hung, ochery.com
Sr Director, Infrastructure Ecosystem, Arm.
The key trends across hardware, cloud and open-source; exploring how these areas are likely to mature and develop over the short and long-term, and then considering how organisations can position themselves to adapt and thrive.
GraphRAG is All You need? LLM & Knowledge GraphGuy Korland
Guy Korland, CEO and Co-founder of FalkorDB, will review two articles on the integration of language models with knowledge graphs.
1. Unifying Large Language Models and Knowledge Graphs: A Roadmap.
https://arxiv.org/abs/2306.08302
2. Microsoft Research's GraphRAG paper and a review paper on various uses of knowledge graphs:
https://www.microsoft.com/en-us/research/blog/graphrag-unlocking-llm-discovery-on-narrative-private-data/
Neuro-symbolic is not enough, we need neuro-*semantic*Frank van Harmelen
Neuro-symbolic (NeSy) AI is on the rise. However, simply machine learning on just any symbolic structure is not sufficient to really harvest the gains of NeSy. These will only be gained when the symbolic structures have an actual semantics. I give an operational definition of semantics as “predictable inference”.
All of this illustrated with link prediction over knowledge graphs, but the argument is general.
The Art of the Pitch: WordPress Relationships and SalesLaura Byrne
Clients don’t know what they don’t know. What web solutions are right for them? How does WordPress come into the picture? How do you make sure you understand scope and timeline? What do you do if sometime changes?
All these questions and more will be explored as we talk about matching clients’ needs with what your agency offers without pulling teeth or pulling your hair out. Practical tips, and strategies for successful relationship building that leads to closing the deal.
UiPath Test Automation using UiPath Test Suite series, part 3DianaGray10
Welcome to UiPath Test Automation using UiPath Test Suite series part 3. In this session, we will cover desktop automation along with UI automation.
Topics covered:
UI automation Introduction,
UI automation Sample
Desktop automation flow
Pradeep Chinnala, Senior Consultant Automation Developer @WonderBotz and UiPath MVP
Deepak Rai, Automation Practice Lead, Boundaryless Group and UiPath MVP
2. Why operations support systems (OSS) are not the answer to all?
Enhanced network performance evaluation
Mobile Network Operator
OSS
Provides valuable information about the network and
triggers capacity enhancements,
but vendor-specific models mostly work on
cell load (%),
medium- to long-term network/cell KPI and
medium- to long-term fault statistics
Mobile Network Testing (MNT) in addition provides the end user view (user perceived capacity):
Free capacity is measured at certain locations instead of % free cell resources
(OSS counters)
It is not “either MNT or OSS/SON” it is “MNT and OSS/SON”!
(MNT to provide validation of vendor specific OSS models and simulation performance)
Do I get all the answers from my OSS?
2
3. OSS performance management sample
ı Simple performance mapping
ı KPI generation with modded source database
ı Integrated tool for thinning out data – Lossy
ı A significant gap between meas time (not real-time)
Enhanced network performance evaluation 3
4. OSS traffic report sample
ı Typical OSS Traffic report ->
ı OSS provides triggers for capacity
enhancements (network view)
ı True network performance
perceived by end users before
capacity enhancement
ı Network Performance should be
measured in a reliable way from
users’ perspective
Enhanced network performance evaluation 4
5. Reasons for using probes in addition to OSS
OSS:
ı Non active testing
ı Not controllable and not reproducible
ı No detailed radio information
ı Limited location precision (except for geo-location solutions)
ı No visibility in coverage gaps
ı No voice/video quality representing user perspective
ı No real time KPIs (generally 15 minutes or more)
ı Large solutions, hence large budget approvals required
ı 3rd party OSS requires integration in Mobile Operators eco-system and processes
ı (+) larger scope and end to end view (including core network)
Enhanced network performance evaluation 5
7. QualiPoc - Product Family Overview
Enhanced network performance evaluation
Optimization
QualiPoc Android THE PREMIER HANDHELD TROUBLESHOOTER
QualiPoc Android is a multi-functional smartphone-based tool for voice, video and data service quality
troubleshooting and RF optimization. As the premier handheld troubleshooter, QualiPoc Android set a
new industry standard for smartphone-based Mobile Network Testing.
Benchmarking
QualiPoc Freerider THE ULTIMATE PORTABLE BENCHMARKER
The compact, lightweight, and well-designed backpack provides extensive functionalities to test voice,
data, video, and messaging to assess quality of service (QoS) and quality of experience (QoE) from a
real end-user perspective, including the complete information about the physical RF environment.
Service Quality Monitoring
QualiPoc Android Probe NON-STOP SERVICE QUALITY MONITORING
QualiPoc Probe is a versatile, smartphone-based mobile network probe for unattended network-wide
non-stop service quality monitoring and optimization. It is remotely controlled and delivers in real-time a
continuous stream of KPIs and insight into network quality just as the customer perceives it.
7
9. QualiPoc Remote Probe with SmartMonitor
Remote Controlled Shell (RCS) with Power Control
Enhanced network performance evaluation 9
10. QualiPoc Remote Control
’Fleet Manager’ NetQual NQDI
Call Server
Media
Server
Communication
Server
QualiPoc
Android
Remote
Control
QualiPoc
Android
Remote
Control
QualiPoc
Android
Remote
Control
CS
NetworkMobile
Network
IP
Network
Control, Monitoring, Analysis and Reporting SW
Remote
probes
NetQual back end
Direct
communication
to probes via
HTTP/HTTPS
Enhanced network performance evaluation 10
11. SmartAnalytics – common analytics solution for all probes
Enhanced network performance evaluation 11
Probes
Analytics and Reporting
Scene Reports
SmartAnalytics
Anywhere, Any device
12. SmartAnalytics
ı SmartAnalytics provides
visibility of the principle
factors influencing network
performance and quality of
experience
ı The network performance
score allows network
operators to identify strategic
areas for investment
Enhanced network performance evaluation 12
“The Network Performance Score is a vendor
independent and objective methodology
across the whole network”
17. Performance Management sample
ı Performance Monitoring – sample various metrics
Traffic distribution
Percentage of packet types
Distribution of packet sizes
Delay distribution
Collisions, CRC errors, Dropped packets
Channel Utilization
ı Performance Management Control
Alarm Thresholds
Traffic control
ı Performance Analysis
Record statistics & network trends.
Effect of traffic load
Define a stable network
Enhanced network performance evaluation 17
18. Advanced Alarming interface
R&S Probes to OSS via JSON
ı Advanced Alarming interface supporting JSON to URL
ı Advanced alarming interface on SmartMonitor is the JSON to URL
ı SmartMonitor will forward received alarms from probes in JSON format
ı JSON (JavaScript Object Notation) is a very convenient and light-weight format for exchanging
data between applications or systems.
ı All network infrastructure vendors offer their own OSS monitoring system to customers. But
those monitoring systems do not see the real end user perspective.
ı Therefore QualiPoc Android Probes and SmartMonitor will deliver this missing view and
information to those systems. OSS monitoring systems offer an interface for 3rd party tools to
provide information and the format used is JSON
Enhanced network performance evaluation 18
19. Measurements to characterize „Network Performance“?
Performance target To be measured
Capacity Remaining data throughput at given location
Coverage Minimum connectivity
Do’s Don’ts
ı Load the network extensively (intrusiveness)
ı Overheat the test equipment / smartphone
(heat significantly affects the UE performance)
ı No ‘bottlenecks’ outside the Mobile Network
(e.g. 3rd party providers, servers, UE etc.
ı Reliable and reproducible measurements
ı Real world: use smartphones’ internal
antennas
ı Real world: Use TCP as data protocol
ı Simple test case but full configurability
ı Should work for all RATs without
preconditions
Enhanced network performance evaluation 19
20. Network Performance Test – definition and typical result
User
data rate
Time
Example of user
experienced data rate
depending on
ı Network load
ı Technology
ı Channel (fading,…)
Data
request
Time
Data
request
Time
Slight dip below
constant data rate
TCP throughput ramp-up
Outage
Average peak
throughput
Enhanced network performance evaluation
Capacity
peak
Continuous TCP load floor
ı R&S methodic
ı All times configurable
ı Capacity peaks = one or
more parallel TCP
connections
20
21. Network Performance Test – Result example LTE-A
Enhanced network performance evaluation
Exp: LTE-Advanced Network:
ı NPT Capacity peaks even triggered
the BS to switch on the 2nd
component carrier (LTE CA –
yellow area) – see t1 and t2
ı Shortly after the capacity peak the
2nd carrier has been switched off
again – see t3
ı TCP load floor at 1Mbps shows
100% full connectivity
ı Results also available on map
True view of your network
21
22. Network Performance Test – Evaluation
Enhanced network performance evaluation
User
data rate
Time
Feasible interpolation of
remaining data throughput
measurement
+ Acceptable interpolation of the remaining network
capacity
Approximation of long term Capacity Test
+ Detection of coverage holes and limited
connectivity
+ Defined / configurable intrusiveness independent
of network technology (EDGE, HSPA, LTE, CA)
+ No temperature or power consumption issues for
testing smartphone
+ Lower costs for SIM/data in testing competitors’
networks (benchmarking)
Evaluation:
Measuring true network performance
with minimum impact on the network load and on the test UE (avoid heating etc.)
22
23. Test Device Containment Module (TCM)
ı Robust casing to protect the device
Hinged top, single latch to release top
Easily replaceable device for future upgrades
Position of the device is upright as in a normal daily use case
ı Unique self-healing functions
Automatically reboot the test device (as in the ASM)
ı Active thermal conditioning for a superior temperature control
Thermal isolating foam
No air-exchange to ambient
Internal active circular airflow for active heating/cooling
Stable and optimal temperature inside the module (23-24C)
External temperature ranges (+45C to -40C)
Enhanced network performance evaluation
Air-flow
23
24. Influence of temperature on performance
Testing throughput on Android Smartphone
ı Testing latest Android Smartphone in a controlled (lab) environment
Different Temperatures applied in a controlled, RF-shielded climate chamber
Simulated Network (using R&S® CMW500)
2 aggregated carriers (Band 7, Band 3) with Max throughput = 127.552 Mbps per carrier
ı Results:
ı Conclusions
Stable temperature conditions needed for maximum results comparability
Enhanced network performance evaluation
218
190
121
0
50
100
150
200
250
Net Application Throughput / Mbps
5°C
15°C
35°C
24
26. IP trace and Layer 3 decoder
ı "IP trace" monitor displays header information from HTTP, FTP, TCP, DNS and ICMP packages
ı QualiPoc updates the monitor in real time.
Enhanced network performance evaluation 26
28. Advanced Analysis Settings
ı "Log captured IP packet": advanced packet details in the IP Monitor
ı Saving signaling messages
Enhanced network performance evaluation 28
29. QualiPoc Android - Supported Test Cases
Test cases
• Video Streaming on YouTube, Netflix, DirecTVnow and Facebook Watch incl. Video-MOS
• App service tests:
• Dropbox (File up and download)
• Facebook (Send post and picture, like post, delete post)
• Ookla Speed Test (Latency, UL and DL throughput)
• Line (Instant messaging)
• Line (VoIP incl. audio MOS using POLQA)
• WhatsApp (Instant messaging)
• WhatsApp (VoIP incl. audio MOS using POLQA)
• FCC Speed app (UDP Latency and Packet Loss / Speed test (GET and POST HTTP)
• Instagram (Send pictures and videos, post text and comments)
• Generic Video Test allows to test any video streaming or live TV service incl. video quality
• Video Telephony including audio and video quality
Enhanced network performance evaluation 29
30. QualiPoc Android
Real-time TCP analysis
ı QualiPoc Android offers
a real time analysis of the TCP stream during measurements
provides a TCP statistics for each executed test.
ı TCP statistics and analysis are done always on data tests even without the
need for recording a PCAP file.
ı The statistics include all data traffic from the smartphone during the test
time and might include some traffic not originated on QualiPoc
Enhanced network performance evaluation 30
34. NQDI – Network Quality Data Investigator
Enhanced network performance evaluation 34
More than 200 KPIs available for service
and network performance reporting and trending
35. NQDI – Features
ı Skype VoIP and Messaging
Same as for WhatsApp or Line we support Skype measurements. NQDI analyzes the results
congruent to the other tests. With this the Network but also the different Apps providing the
service can be compared against each other in different networks and/or network conditions,
phones, configurations etc.
35Enhanced network performance evaluation
COMPANY RESTRICTED
36. LIST OF REFERENCES
ı Success of Digital Services Hinges on BSS/OSS, InterComms Magazine
ı Win at digital transformation: How to adopt agile BSS/OSS, TM Forum global industry
association
ı ECMA-404 The JSON Data Interchange Standard
ı YANG Logical Network Elements, IETF Tools
ı Network Inventory Model, MCH information & communication solutions
ı Next Generation Telecom OSS, Network, Amdocs
ı Others
Enhanced network performance evaluation 36
40. QualiPoc Android
Generic Video Streaming test
ı Define start- and stop- scripts, so no manual interaction is needed!
Enhanced network performance evaluation
Start script:
Stop script:
Increase flexibility
Test more sensitive
Test more efficient
40
41. QualiPoc Android
Application Service Tests
App service tests supported on QualiPoc:
ı FCC speed test: This speed test app includes UDP Latency and Packet Loss
as well as speed test (GET and POST HTTP)
ı Instagram: Supported actions Send pictures and videos, post text and comments.
Measured KPIs: Time taken to deliver a picture (post), Time taken to deliver a video
(post), Time taken to deliver a post comment/text, Time taken to measure successful
delivery of the post comment.
Enhanced network performance evaluation 41