2019 HPCC
Systems®
Community Day
Challenge Yourself –
Challenge the Status Quo
The Path to 8.0Gavin Halliday
Enterprise Lead
Architect
LexisNexis Risk
Solutions
Cloud
Cloud
• Recent steps
• Thor startup speed
• ROXIE restructuring
• Storing hostnames in the environment
• Path to 8.0
• Consistent component-specific configurations
• Containers for components
• Kubernetes deployment
• Efficient unattached storage
Path to 8.0 3
Security
Security
• Recent steps
• Dali connection whitelist
• Restricted Files and signed code
• Dafilesrv authenticated access
• Path to 8.0
• Complete restricted files
• Complete dafilesrv changes
• Trusted components, secure connections
Path to 8.0 5
Interoperability
Interoperability
• Recent changes
• Reading and writing HPCC Systems files from Spark
• Refactoring the disk processing code
• Path to 8.0
• Pluggable interface for internal and external file formats
Path to 8.0 7
Productivity
Productivity
• Recent steps
• Data patterns integration into ECLWatch
• Workunit analysis tool
• Path to 8.0
• Further Data Patterns integration
• More rules for the workunit analysis tool
• Better system monitoring
Path to 8.0 9
2019 HPCC
Systems®
Community Day
Challenge Yourself –
Challenge the Status Quo
The Path to 8.0Gavin Halliday
View this presentation on YouTube:
https://www.youtube.com/watch?v=Z1A3nOuhv3A&list=PL-
8MJMUpp8IKH5-d56az56t52YccleX5h&index=11&t=43s (1:22:43)

Path to 8.0

  • 1.
    2019 HPCC Systems® Community Day ChallengeYourself – Challenge the Status Quo The Path to 8.0Gavin Halliday Enterprise Lead Architect LexisNexis Risk Solutions
  • 2.
  • 3.
    Cloud • Recent steps •Thor startup speed • ROXIE restructuring • Storing hostnames in the environment • Path to 8.0 • Consistent component-specific configurations • Containers for components • Kubernetes deployment • Efficient unattached storage Path to 8.0 3
  • 4.
  • 5.
    Security • Recent steps •Dali connection whitelist • Restricted Files and signed code • Dafilesrv authenticated access • Path to 8.0 • Complete restricted files • Complete dafilesrv changes • Trusted components, secure connections Path to 8.0 5
  • 6.
  • 7.
    Interoperability • Recent changes •Reading and writing HPCC Systems files from Spark • Refactoring the disk processing code • Path to 8.0 • Pluggable interface for internal and external file formats Path to 8.0 7
  • 8.
  • 9.
    Productivity • Recent steps •Data patterns integration into ECLWatch • Workunit analysis tool • Path to 8.0 • Further Data Patterns integration • More rules for the workunit analysis tool • Better system monitoring Path to 8.0 9
  • 10.
    2019 HPCC Systems® Community Day ChallengeYourself – Challenge the Status Quo The Path to 8.0Gavin Halliday
  • 11.
    View this presentationon YouTube: https://www.youtube.com/watch?v=Z1A3nOuhv3A&list=PL- 8MJMUpp8IKH5-d56az56t52YccleX5h&index=11&t=43s (1:22:43)