GemStone Update 2023

E
ESUGESUG
GemStone Update
Norm Green and:[ James Foster ]
ESUG 2023
Lyon, France
August 30, 2023
2
Academia vs Business…
Part 1
GemTalk: Who We Are
4
Our History
• 41 Years of Continuous Operation
– Founded: 1982 (as Servio Logic Corporation)
– First Version of GemStone Shipped: 1986
– Name Changed from Servio to GemStone: 1995
– Acquired by Brokat: July 2000
– Management buyout: June 2001
– Acquired by VMware: May 2010
– Acquired by GemTalk Systems: May 2013
5
Financial and Trading Vertical
Kapital is the world leading derivatives trading and
management system – since 1993
DBO is a very large precious metals trading and settlement
system.
- since 1990
ICE is the world’s fastest growing electronic trading exchange
– since 1994
MMI Holdings – Financial portfolio management system. –
since 1995
Lifeware – Cloud-based insurance management solutions –
since 2000
Guava – Financial & treasury Software – since 1998
GemStone Powered Business
6
Manufacturing Vertical
Works application for semiconductor manufacturing
– since 1991
Semiconductor manufacturing software – since 1998
GemStone Powered Business
HVAC software – since 2012
Adhesives Manufacturing – since 1997
7
Utilities Vertical
TCMS II- Trouble Call Management System V2
GemStone Powered Business
GemTalk provides remote administration and emergency on-call support to augment FPL staff
8
Telecommunications Vertical
Telecom Service Provisioning for Argentina – since 2004
GemStone Powered Business
CONDIS – Inventory and cable management – since 1993
Telecom Workflow Management – since 2013
Government Vertical
Border Security – since 1996
Visa Processing – since 2004
Dutch Agricultural Institute – agriculture data collection
– since 1998
GemStone Powered Business
10
GemTalk Partners
11
GemTalk In the Community…
▪ Conferences and Groups
▪ Pharo Consortium (Industrial Member)
▪ ESUG (Platinum Sponsor)
▪ FAST (Platinum Sponsor)
12
The GemTalk Team
13
GemTalk – The Next Generation
▪ Welcome Kurt Kilpela!
▪ Joined GemTalk on May, 2019
▪ From Kurt’s Cover Letter:
Early in my education, I was
introduced to Smalltalk. Prior to
this, my training was in Java, C, and
C++. Initially, it felt bizarre. In
just a few days, I fell in love.
14
GemTalk – The Next Generation
▪ Welcome Andres Valloud!
▪ Joined GemTalk in June, 2022
▪ Projects
▪ x86_64 native code generator improvements
▪ ARM aarch64 native code generator
15
GemTalk – The Next Generation
▪ Welcome Alissa Friel!
▪ Joined GemTalk in August, 2023
▪ BSc. Computer Science,
Portland State University
Part 2
GemStone Software:
A Lightning Tutorial
17
How Many Have A Good
Feel For What
GemStone Is?
How Many Have Actually
Used GemStone ?
18
So What Is This GemStone Thing?
• A solution to the limitations of traditional Smalltalk:
1. Object space limited to one VM.
2. Object space limited to one host.
3. Object space limited to available RAM.
4. Object changes (since last image save) lost when VM exits.
19
Welcome To The World Of GemStone!
• Object space visible to thousands of VMs on
thousands of machines.
• Object space limited by disk, not RAM.
• Object changes managed by ACID transactions
– Atomic
– Consistent
– Isolated
– Durable
• Object changes guaranteed persistent once
committed.
20
Key Features Of GemStone
• Scalability
– Billions of objects
– Thousands of users.
– Thousands of machines.
– Thousands of transactions per second.
– Terabytes of data.
21
Key Features Of GemStone
• Concurrency
– Multiple user sessions.
– Built-in database transactions.
• Commit
• Abort
• Continue
– Optimistic Concurrency
• Reduced Conflict Collections
– Pessimistic Concurrency
• Object-level read/write locks.
– Namespaces
• Shared and private.
22
Key Features Of GemStone
• Security
– Object-level security.
• User, group, world permissions.
– Login Security
• User-id / Password
• Single-Sign-On (GSSAPI / Kerberos)
• LDAP
• PAM
• X509 Certificate
– Administrative Privileges
• #GarbageCollection
• #OtherPassword
• #SystemControl
23
Key Features Of GemStone
• 100% Smalltalk (“It’s turtles, all the way down”)
– All objects, all the time.
– Classes, methods, blocks, exceptions.
– ANSI Smalltalk compliant
24
Key Features Of GemStone
• Very Large Collection Support
– Collections of millions of objects.
– Optimized searches using b-tree Indexes:
• Equality Indexes (a = b)
– AllEmployees detect:{:each| each.lastName = ‘Ducasse’ }
• Identity Indexes (a == b)
– AllEmployees select:{:each| each.countryOfOrigin == #France }
25
Key Features Of GemStone
• Interfaces to Other Smalltalks
– VisualWorks® - GemBuilder for VisualWorks®
– VA Smalltalk® - GemBuilder for VA Smalltalk®
– Pharo – tODE, GsDevKit, Sparkle, gt4Gemstone
– Jade / Jadeite (Dolphin, open source)
• Interfaces To Other Languages
– C/C++ - GemBuilder for C
– Java – GemBuilder for Java
• Interfaces to Relational Databases
– Oracle – GemConnect for Oracle
– Postgres – GemConnect for Postgres
– Sybase – GemConnect for Sybase (open source)
26
GemStone/S 64 Platforms
• Object Server (Database)
– Linux:
• x86_64 (Intel / AMD)
• aarch64 (ARM) ** NEW ** (non-production only)
– Apple MacOS:
• x86_64
• M1, M2 (Apple Silicone)
– Oracle Solaris: x86_64
– IBM: AIX PowerPC 64 bit
– Raspberry Pi aarch64
• Object Clients
– All of the above, and:
• Microsoft Windows 10,11
27
GemBuilder for Smalltalk (GBS) Platforms
• Cincom® VisualWorks® 9.1.1
– MS Windows 10/11
– Linux 32/64 bit
• Instantiations VA Smalltalk™ 11.0.1, 10.0.2, 8.6.3
– MS Windows 10/11
28
Jade IDE
• Open source IDE for all versions of GemStone
• Written in Dolphin Smalltalk by James Foster
• MS Windows only
• Supports all versions of GemStone
• Free of charge
• Rich set of tools
– Browsers
– Inspectors
– Debuggers
• https://github.com/jgfoster/Jade
Jade System Browser
29
30
Jadeite IDE
• Fork of the Jade project
• Currently in development at GemTalk for a customer in
Europe
• Support for source code control with Rowan and Git
• Support for Tonal file format
• Migration tools from other SCM systems
31
GemStone/S Licensing Models
• Community Editions
– Free (as in beer) for any use (including commercial)
• Perpetual
– Buy once, own it forever
• Annual Subscription
– Pay annually, cancel any time.
• Value Added Reseller (VAR)
– Percentage of royalties
32
GemStone Community Edition
Starter Limited Full Extended SPC Extended CPU Extended Full
License Kind Perpetual Subscription Subscription Subscription Subscription Subscription
Cores 2 2 2 2 4 4
SPC 1 G 2 G 2G 4G 2G 4G
Gems 10 20 Unlimited Unlimited Unlimited Unlimited
Disk 10G 50G Unlimited Unlimited Unlimited Unlimited
Development DB Unlimited Unlimited Unlimited Unlimited Unlimited Unlimited
Production DB 1 2 Unlimited Unlimited Unlimited Unlimited
Tech Support Community Community 5 tickets 10 tickets 10 tickets 20 tickets
Price Free Free $1500/yr $3000/yr $3000/yr $6000/yr
Distribution With Product Email addr Sales Sales Sales Sales
Source: http://gemtalksystems.com/index.php/lc-licensing/
33
Support Models
• Web Support (24 x 7)
– https://techsupport.gemtalksystems.com
– Help requests processed 8 am – 5 pm Pacific Time
• Emergency 24 x 7 Support
– Available for a premium
– GemTalk provides an emergency phone number
– Call back to the customer within 15 minutes
• Mailing Lists
– GLASS – Open source projects: Seaside / GLASS / tODE
– GemStone Smalltalk – GemStone-specific
– Sign up at:
• https://lists.gemtalksystems.com/mailman/listinfo/
Part 3
Roadmap
35
On Agile Programming…
36
Recent GS/64 Server Releases
• Version 3.7.0
– August 2023 September 2023
• Version 3.7.1
– February 2024
• Version 3.6.x
– 3.6.6: May 2023
– 3.6.7: December 2023
37
New In Version 3.6
• Support for DARE (Data At Rest Encryption)
– Optional encryption of database extents and tranlogs
– Encryption done at the database page level
• Each page is encrypted individually
– Encryption Mode: XTS-AES
• XTS == XEX-based tweaked-codebook mode with ciphertext
stealing
• Support for 128 and 256 bit XTS keys
• XTS is supported by: BestCrypt, TrueCrypt, VeraCrypt,
DiskCryptor, MS Bitlocker, wolfCrypt.
– Private key (and passphrase) required to start encrypted
GemStone database.
38
New In Version 3.6
• Support for DARE (Data At Rest Encryption)
– Encrypt / decrypt via copydbf utility
• Creating an encrypted database extent:
$GEMSTONE/bin/copydbf –e dbCert.pem –s 128 
–K /home/normg/certs 
$GEMSTONE/data/extent0.dbf $GEMSTONE/data/extent0.sdbf
• Starting an encrypted database:
$GEMSTONE/bin/startstone –D dbPrivateKey.pem 
–J ~/secrets/passphrase.txt –K /home/normg/keys
-z $GEMSTONE/data/system.conf normstone
39
New In Version 3.6
• Restricted System >>performOnServer:
– If enabled, each UserProfile has a whitelist of permited
performOnServer: commands.
– Only commands on the whitelist may be executed.
– Default whitelist is empty.
– Example of adding a permitted command (git)
|up|
up := AllUsers userWithId: ‘normg’.
up addPrivilege: ‘NoPerformOnServer’ ;
addPerformOnServerCommands: (Array with: ‘/usr/bin/git’) .
40
New In Version 3.6
• 4 New Special Classes
– Also known as immediate objects
– Value encoded in the object ID
– Never occupy disk space
• SmallDate
• SmallDateAndTime
• SmallScaledDecimal
• SmallTime
41
New In Version 3.6
• gslist output as JSON:
normg@moop>gslist -j
{"GemStoneServers":[
{
"Name":"norm",
"Host":"moop",
"HostId":"b6f9ea8dee7eca73",
"Ip":"10.94.141.31",
"Status":"Exists",
"Type":"Stone",
"Version":"3.6.0",
"Creator":"normg",
"Started":"2020-09-21T12:44:59.000-07:00",
"Pid": 7733,
"Port": 38423, ….
42
New in Version 3.6
• Amazon AWS Customer Master Key (CMK) Support
– Encrypted data stored in GemStone.
– Encryption keys managed by AWS.
– Cloud user controls if/when data is unlocked and accessed.
43
Version 3.7
• Performance, performance, performance!
– We’ve made everything faster
• startstone
• stopstone
• markForCollection
• Backup
• Restore
• page reclaim
• Smalltalk VM (thanks Andres!)
44
Version 3.7
• Support Monitoring GemStone with Prometheus
– “Prometheus is an open-source systems monitoring and
alerting toolkit originally built at SoundCloud. Since its
inception in 2012, many companies and organizations have
adopted Prometheus, and the project has a very active
developer and user community. It is now a standalone open
source project and maintained independently of any company.”
- https://prometheus.io
45
Prometheus Monitoring Sample
46
Version 3.7
• Faster Smalltalk VM on x86_64
– Native code generator optimized by Andres Valloud
– Reduce number of instructions and number of branches
– Better branch prediction
– Average ~35% improvement
47
Version 3.7
• Microsoft Azure Customer Master Key (CMK) Support
– Encrypted data stored in GemStone.
– Encryption keys managed by Azure.
48
Version 3.7
• Fast Instance Migration
– Migrate and commit all instances of up to 2000 classes in a
single operation.
– Multi-threaded: uses multiple C threads for speed.
– Typical Use Case: Add a new instance variable.
49
Version 3.7
• OpenSSL upgraded from v1.1.1x to version v3.0.x
• ssh Support
– New Class: GsSshSocket
– Execute remote commands via ssh
• sftp Support
– New Classes: GsSftpSocket, GsSftpRemoteFile
– Upload and download files via sftp
50
Version 3.7
• Faster Read Streams on Strings
– New Class: ReadByteStream
– Optimized for reading String and byte objects.
• String Auto Promotion to Unicode16
– When a code point greater than 255 is added to a String, it is
promoted to Unicode16.
51
Version 3.7
• New Cryptographic Hash Methods (to play nicer with
Pharo…)
– We can now a hash result as any of:
• LargeInteger
• String
• ByteArray (new)
‘abc’ perform: #sha256Sum
-Answers a String of hex digits
‘abc’ perform: #sha256SumBytes
-Answers a ByteArray
52
Version 3.7
• Native Support for FileSystem
– FileSystem is now included in the GemStone base image
– Code ported from Pharo
– Major Classes
• FileReference
• FileSystem
• FileLocator
• FsFileDescriptor
53
Version 3.7
• New GsSecureSocket features:
– GsSecureSocket == GemStone’s TLS Socket Interface
– Pre-shared keys (PSK)
• Connect using a secret known to both the client and server.
– Anonymous TLS
• Encrypted connection with no authentication
54
Version 3.7
• Customer-defined Special (Immediate) Objects
– 16 new Immediate classes for use by customers
– Each instance stores up to 56 bits of customer-defined data
– Example: Money
• Currency (4 bits):
– Euro
– US$
– CAN$
– Yen
• Amount (52 bits)
– Answers a Scaled Decimal
• Example code shipped in:
– $GEMSTONE/examples/smalltalk/Money.gs
55
Version 3.7
• One-time Passwords
– Create a temporary password valid for a single login.
– Password lifetime specified in seconds.
– Example:
GsCurrentSession currentSession
createOneTimePasswordForUserId: ‘NormG’
validForSeconds: 60
56
Version 3.7
• Rowan – GemStone’s New Package Manager
– Preview Version Only.
– Talk to Dale
57
Version 3.7.1
• Native Code Support on Linux ARM64
– 3.7.0 supports only interpreted mode
• Still More VM improvements on Linux x86_64
– Thanks Again Andres!
• Bug fixes
58
Version 3.8 and Beyond…
• Native ROWAN support
– ROWAN is a new package manager that supports FileTree
and Tonel repositories.
– https://github.com/GemTalk/Rowan
• Pharo Support (Sparkle)
– Not GBS for Pharo
– Inspectors and debuggers
– Work In progress.
– https://github.com/GemTalk/Sparkle
– No GA date yet.
– Martin’s UK Smalltalk talk: https://vimeo.com/676889959
– More in Martin McClure’s talk Thursday @ 9 am
59
New Open-Source Projects
• Jadite For Pharo
– Pharo IDE for GemStone Code Development Using Rowan
– Work in progress, NOT ready for prime-time
– Talk to Dale
• https://github.com/GemTalk/JadeiteForPharo
60
New Open-Source Projects
• GemConnect for Postgres
– 100% Smalltalk code via FFI
– Requires GemStone/64 v3.6.2 or later
– Available as open source on github:
• https://github.com/GemTalk/GemConnect-for-Postgres
• GemConnect for RabbitMQ
– 100% Smalltalk code via FFI
– Requires GemStone/64 v3.6.4 or later
– Available as open source on github:
• https://github.com/GemTalk/GemConnectForRabbitMQ
Questions?
61
GemTalk Systems LLC
15220 NW Greenbrier Pkwy., Suite 240
Beaverton, Oregon, 97006
Mobile: (503) 804-2041
norm.green@gemtalksystems.com
Norman R. Green
Senior VP & Chief Technical Officer
www.gemtalksystems.com
®
1 of 61

Recommended

GemStone Update by
GemStone Update GemStone Update
GemStone Update ESUG
84 views49 slides
Gemstone RoadMap by
Gemstone RoadMapGemstone RoadMap
Gemstone RoadMapESUG
242 views43 slides
GemStone/S 64 Update by
 GemStone/S 64 Update GemStone/S 64 Update
GemStone/S 64 UpdateESUG
350 views47 slides
GemStone/64 product update and road map by
GemStone/64 product update and road mapGemStone/64 product update and road map
GemStone/64 product update and road mapESUG
503 views53 slides
Glass by
GlassGlass
GlassESUG
260 views39 slides
Gemstone 64 Product Overview by
Gemstone 64 Product OverviewGemstone 64 Product Overview
Gemstone 64 Product OverviewESUG
960 views45 slides

More Related Content

Similar to GemStone Update 2023

GemStone/64 Update by
GemStone/64 UpdateGemStone/64 Update
GemStone/64 UpdateESUG
349 views40 slides
Secure container: Kata container and gVisor by
Secure container: Kata container and gVisorSecure container: Kata container and gVisor
Secure container: Kata container and gVisorChing-Hsuan Yen
395 views40 slides
Abc beagleboard Getting To Know It by
Abc beagleboard Getting To Know ItAbc beagleboard Getting To Know It
Abc beagleboard Getting To Know Itrviolachurch
1K views44 slides
.NET Memory Primer (Martin Kulov) by
.NET Memory Primer (Martin Kulov).NET Memory Primer (Martin Kulov)
.NET Memory Primer (Martin Kulov)ITCamp
527 views30 slides
14 scaleabilty wics by
14 scaleabilty wics14 scaleabilty wics
14 scaleabilty wicsashish61_scs
538 views87 slides
WebRTC Browsers n Stacks Implementation differences by
WebRTC Browsers n Stacks Implementation differencesWebRTC Browsers n Stacks Implementation differences
WebRTC Browsers n Stacks Implementation differencesAlexandre Gouaillard
4.8K views42 slides

Similar to GemStone Update 2023(20)

GemStone/64 Update by ESUG
GemStone/64 UpdateGemStone/64 Update
GemStone/64 Update
ESUG349 views
Secure container: Kata container and gVisor by Ching-Hsuan Yen
Secure container: Kata container and gVisorSecure container: Kata container and gVisor
Secure container: Kata container and gVisor
Ching-Hsuan Yen395 views
Abc beagleboard Getting To Know It by rviolachurch
Abc beagleboard Getting To Know ItAbc beagleboard Getting To Know It
Abc beagleboard Getting To Know It
rviolachurch1K views
.NET Memory Primer (Martin Kulov) by ITCamp
.NET Memory Primer (Martin Kulov).NET Memory Primer (Martin Kulov)
.NET Memory Primer (Martin Kulov)
ITCamp527 views
WebRTC Browsers n Stacks Implementation differences by Alexandre Gouaillard
WebRTC Browsers n Stacks Implementation differencesWebRTC Browsers n Stacks Implementation differences
WebRTC Browsers n Stacks Implementation differences
Next generation storage: eliminating the guesswork and avoiding forklift upgrade by Jisc
Next generation storage: eliminating the guesswork and avoiding forklift upgradeNext generation storage: eliminating the guesswork and avoiding forklift upgrade
Next generation storage: eliminating the guesswork and avoiding forklift upgrade
Jisc1.9K views
GemStone/S 64bit by ESUG
GemStone/S 64bitGemStone/S 64bit
GemStone/S 64bit
ESUG385 views
Ethereum Devcon1 Report (summary writing) by Tomoaki Sato
Ethereum Devcon1 Report (summary writing)Ethereum Devcon1 Report (summary writing)
Ethereum Devcon1 Report (summary writing)
Tomoaki Sato3.7K views
Chronicle accelerate building a digital currency by Peter Lawrey
Chronicle accelerate   building a digital currencyChronicle accelerate   building a digital currency
Chronicle accelerate building a digital currency
Peter Lawrey661 views
CSF18 - GDPR - Sami Laiho by NCCOMMS
CSF18 - GDPR - Sami LaihoCSF18 - GDPR - Sami Laiho
CSF18 - GDPR - Sami Laiho
NCCOMMS222 views
Designs, Lessons and Advice from Building Large Distributed Systems by Daehyeok Kim
Designs, Lessons and Advice from Building Large Distributed SystemsDesigns, Lessons and Advice from Building Large Distributed Systems
Designs, Lessons and Advice from Building Large Distributed Systems
Daehyeok Kim120 views
Open Source Investments in Mainframe Through the Next Generation - Showcasing... by Open Mainframe Project
Open Source Investments in Mainframe Through the Next Generation - Showcasing...Open Source Investments in Mainframe Through the Next Generation - Showcasing...
Open Source Investments in Mainframe Through the Next Generation - Showcasing...
Introduction of Java GC Tuning and Java Java Mission Control by Leon Chen
Introduction of Java GC Tuning and Java Java Mission ControlIntroduction of Java GC Tuning and Java Java Mission Control
Introduction of Java GC Tuning and Java Java Mission Control
Leon Chen20.5K views
ODSA Sub-Project Launch by Netronome
 ODSA Sub-Project Launch ODSA Sub-Project Launch
ODSA Sub-Project Launch
Netronome582 views
Internet of Things, Mobility & .Net Micro Framework SydMobNet March 2014 by Alec Tucker
Internet of Things, Mobility & .Net Micro Framework SydMobNet March 2014Internet of Things, Mobility & .Net Micro Framework SydMobNet March 2014
Internet of Things, Mobility & .Net Micro Framework SydMobNet March 2014
Alec Tucker2.2K views

More from ESUG

Workshop: Identifying concept inventories in agile programming by
Workshop: Identifying concept inventories in agile programmingWorkshop: Identifying concept inventories in agile programming
Workshop: Identifying concept inventories in agile programmingESUG
12 views16 slides
Technical documentation support in Pharo by
Technical documentation support in PharoTechnical documentation support in Pharo
Technical documentation support in PharoESUG
31 views39 slides
The Pharo Debugger and Debugging tools: Advances and Roadmap by
The Pharo Debugger and Debugging tools: Advances and RoadmapThe Pharo Debugger and Debugging tools: Advances and Roadmap
The Pharo Debugger and Debugging tools: Advances and RoadmapESUG
56 views44 slides
Sequence: Pipeline modelling in Pharo by
Sequence: Pipeline modelling in PharoSequence: Pipeline modelling in Pharo
Sequence: Pipeline modelling in PharoESUG
86 views22 slides
Migration process from monolithic to micro frontend architecture in mobile ap... by
Migration process from monolithic to micro frontend architecture in mobile ap...Migration process from monolithic to micro frontend architecture in mobile ap...
Migration process from monolithic to micro frontend architecture in mobile ap...ESUG
22 views35 slides
Analyzing Dart Language with Pharo: Report and early results by
Analyzing Dart Language with Pharo: Report and early resultsAnalyzing Dart Language with Pharo: Report and early results
Analyzing Dart Language with Pharo: Report and early resultsESUG
107 views30 slides

More from ESUG(20)

Workshop: Identifying concept inventories in agile programming by ESUG
Workshop: Identifying concept inventories in agile programmingWorkshop: Identifying concept inventories in agile programming
Workshop: Identifying concept inventories in agile programming
ESUG12 views
Technical documentation support in Pharo by ESUG
Technical documentation support in PharoTechnical documentation support in Pharo
Technical documentation support in Pharo
ESUG31 views
The Pharo Debugger and Debugging tools: Advances and Roadmap by ESUG
The Pharo Debugger and Debugging tools: Advances and RoadmapThe Pharo Debugger and Debugging tools: Advances and Roadmap
The Pharo Debugger and Debugging tools: Advances and Roadmap
ESUG56 views
Sequence: Pipeline modelling in Pharo by ESUG
Sequence: Pipeline modelling in PharoSequence: Pipeline modelling in Pharo
Sequence: Pipeline modelling in Pharo
ESUG86 views
Migration process from monolithic to micro frontend architecture in mobile ap... by ESUG
Migration process from monolithic to micro frontend architecture in mobile ap...Migration process from monolithic to micro frontend architecture in mobile ap...
Migration process from monolithic to micro frontend architecture in mobile ap...
ESUG22 views
Analyzing Dart Language with Pharo: Report and early results by ESUG
Analyzing Dart Language with Pharo: Report and early resultsAnalyzing Dart Language with Pharo: Report and early results
Analyzing Dart Language with Pharo: Report and early results
ESUG107 views
Transpiling Pharo Classes to JS ECMAScript 5 versus ECMAScript 6 by ESUG
Transpiling Pharo Classes to JS ECMAScript 5 versus ECMAScript 6Transpiling Pharo Classes to JS ECMAScript 5 versus ECMAScript 6
Transpiling Pharo Classes to JS ECMAScript 5 versus ECMAScript 6
ESUG37 views
A Unit Test Metamodel for Test Generation by ESUG
A Unit Test Metamodel for Test GenerationA Unit Test Metamodel for Test Generation
A Unit Test Metamodel for Test Generation
ESUG53 views
Creating Unit Tests Using Genetic Programming by ESUG
Creating Unit Tests Using Genetic ProgrammingCreating Unit Tests Using Genetic Programming
Creating Unit Tests Using Genetic Programming
ESUG46 views
Threaded-Execution and CPS Provide Smooth Switching Between Execution Modes by ESUG
Threaded-Execution and CPS Provide Smooth Switching Between Execution ModesThreaded-Execution and CPS Provide Smooth Switching Between Execution Modes
Threaded-Execution and CPS Provide Smooth Switching Between Execution Modes
ESUG52 views
Exploring GitHub Actions through EGAD: An Experience Report by ESUG
Exploring GitHub Actions through EGAD: An Experience ReportExploring GitHub Actions through EGAD: An Experience Report
Exploring GitHub Actions through EGAD: An Experience Report
ESUG17 views
Pharo: a reflective language A first systematic analysis of reflective APIs by ESUG
Pharo: a reflective language A first systematic analysis of reflective APIsPharo: a reflective language A first systematic analysis of reflective APIs
Pharo: a reflective language A first systematic analysis of reflective APIs
ESUG57 views
Garbage Collector Tuning by ESUG
Garbage Collector TuningGarbage Collector Tuning
Garbage Collector Tuning
ESUG20 views
Improving Performance Through Object Lifetime Profiling: the DataFrame Case by ESUG
Improving Performance Through Object Lifetime Profiling: the DataFrame CaseImproving Performance Through Object Lifetime Profiling: the DataFrame Case
Improving Performance Through Object Lifetime Profiling: the DataFrame Case
ESUG43 views
Pharo DataFrame: Past, Present, and Future by ESUG
Pharo DataFrame: Past, Present, and FuturePharo DataFrame: Past, Present, and Future
Pharo DataFrame: Past, Present, and Future
ESUG43 views
thisContext in the Debugger by ESUG
thisContext in the DebuggerthisContext in the Debugger
thisContext in the Debugger
ESUG36 views
Websockets for Fencing Score by ESUG
Websockets for Fencing ScoreWebsockets for Fencing Score
Websockets for Fencing Score
ESUG18 views
ShowUs: PharoJS.org Develop in Pharo, Run on JavaScript by ESUG
ShowUs: PharoJS.org Develop in Pharo, Run on JavaScriptShowUs: PharoJS.org Develop in Pharo, Run on JavaScript
ShowUs: PharoJS.org Develop in Pharo, Run on JavaScript
ESUG46 views
Advanced Object- Oriented Design Mooc by ESUG
Advanced Object- Oriented Design MoocAdvanced Object- Oriented Design Mooc
Advanced Object- Oriented Design Mooc
ESUG85 views
A New Architecture Reconciling Refactorings and Transformations by ESUG
A New Architecture Reconciling Refactorings and TransformationsA New Architecture Reconciling Refactorings and Transformations
A New Architecture Reconciling Refactorings and Transformations
ESUG28 views

Recently uploaded

Short_Story_PPT.pdf by
Short_Story_PPT.pdfShort_Story_PPT.pdf
Short_Story_PPT.pdfutkarshsatishkumarsh
5 views16 slides
EV Charging App Case by
EV Charging App Case EV Charging App Case
EV Charging App Case iCoderz Solutions
5 views1 slide
AI and Ml presentation .pptx by
AI and Ml presentation .pptxAI and Ml presentation .pptx
AI and Ml presentation .pptxFayazAli87
12 views15 slides
Programming Field by
Programming FieldProgramming Field
Programming Fieldthehardtechnology
5 views9 slides
FIMA 2023 Neo4j & FS - Entity Resolution.pptx by
FIMA 2023 Neo4j & FS - Entity Resolution.pptxFIMA 2023 Neo4j & FS - Entity Resolution.pptx
FIMA 2023 Neo4j & FS - Entity Resolution.pptxNeo4j
8 views26 slides
Copilot Prompting Toolkit_All Resources.pdf by
Copilot Prompting Toolkit_All Resources.pdfCopilot Prompting Toolkit_All Resources.pdf
Copilot Prompting Toolkit_All Resources.pdfRiccardo Zamana
10 views4 slides

Recently uploaded(20)

AI and Ml presentation .pptx by FayazAli87
AI and Ml presentation .pptxAI and Ml presentation .pptx
AI and Ml presentation .pptx
FayazAli8712 views
FIMA 2023 Neo4j & FS - Entity Resolution.pptx by Neo4j
FIMA 2023 Neo4j & FS - Entity Resolution.pptxFIMA 2023 Neo4j & FS - Entity Resolution.pptx
FIMA 2023 Neo4j & FS - Entity Resolution.pptx
Neo4j8 views
Copilot Prompting Toolkit_All Resources.pdf by Riccardo Zamana
Copilot Prompting Toolkit_All Resources.pdfCopilot Prompting Toolkit_All Resources.pdf
Copilot Prompting Toolkit_All Resources.pdf
Riccardo Zamana10 views
Dapr Unleashed: Accelerating Microservice Development by Miroslav Janeski
Dapr Unleashed: Accelerating Microservice DevelopmentDapr Unleashed: Accelerating Microservice Development
Dapr Unleashed: Accelerating Microservice Development
Miroslav Janeski10 views
DSD-INT 2023 Exploring flash flood hazard reduction in arid regions using a h... by Deltares
DSD-INT 2023 Exploring flash flood hazard reduction in arid regions using a h...DSD-INT 2023 Exploring flash flood hazard reduction in arid regions using a h...
DSD-INT 2023 Exploring flash flood hazard reduction in arid regions using a h...
Deltares9 views
DSD-INT 2023 Simulation of Coastal Hydrodynamics and Water Quality in Hong Ko... by Deltares
DSD-INT 2023 Simulation of Coastal Hydrodynamics and Water Quality in Hong Ko...DSD-INT 2023 Simulation of Coastal Hydrodynamics and Water Quality in Hong Ko...
DSD-INT 2023 Simulation of Coastal Hydrodynamics and Water Quality in Hong Ko...
Deltares14 views
Team Transformation Tactics for Holistic Testing and Quality (Japan Symposium... by Lisi Hocke
Team Transformation Tactics for Holistic Testing and Quality (Japan Symposium...Team Transformation Tactics for Holistic Testing and Quality (Japan Symposium...
Team Transformation Tactics for Holistic Testing and Quality (Japan Symposium...
Lisi Hocke35 views
.NET Developer Conference 2023 - .NET Microservices mit Dapr – zu viel Abstra... by Marc Müller
.NET Developer Conference 2023 - .NET Microservices mit Dapr – zu viel Abstra....NET Developer Conference 2023 - .NET Microservices mit Dapr – zu viel Abstra...
.NET Developer Conference 2023 - .NET Microservices mit Dapr – zu viel Abstra...
Marc Müller40 views
360 graden fabriek by info33492
360 graden fabriek360 graden fabriek
360 graden fabriek
info33492122 views
Quality Engineer: A Day in the Life by John Valentino
Quality Engineer: A Day in the LifeQuality Engineer: A Day in the Life
Quality Engineer: A Day in the Life
John Valentino6 views
Fleet Management Software in India by Fleetable
Fleet Management Software in India Fleet Management Software in India
Fleet Management Software in India
Fleetable11 views
Gen Apps on Google Cloud PaLM2 and Codey APIs in Action by Márton Kodok
Gen Apps on Google Cloud PaLM2 and Codey APIs in ActionGen Apps on Google Cloud PaLM2 and Codey APIs in Action
Gen Apps on Google Cloud PaLM2 and Codey APIs in Action
Márton Kodok6 views
Unmasking the Dark Art of Vectored Exception Handling: Bypassing XDR and EDR ... by Donato Onofri
Unmasking the Dark Art of Vectored Exception Handling: Bypassing XDR and EDR ...Unmasking the Dark Art of Vectored Exception Handling: Bypassing XDR and EDR ...
Unmasking the Dark Art of Vectored Exception Handling: Bypassing XDR and EDR ...
Donato Onofri860 views
Generic or specific? Making sensible software design decisions by Bert Jan Schrijver
Generic or specific? Making sensible software design decisionsGeneric or specific? Making sensible software design decisions
Generic or specific? Making sensible software design decisions
Dev-HRE-Ops - Addressing the _Last Mile DevOps Challenge_ in Highly Regulated... by TomHalpin9
Dev-HRE-Ops - Addressing the _Last Mile DevOps Challenge_ in Highly Regulated...Dev-HRE-Ops - Addressing the _Last Mile DevOps Challenge_ in Highly Regulated...
Dev-HRE-Ops - Addressing the _Last Mile DevOps Challenge_ in Highly Regulated...
TomHalpin96 views

GemStone Update 2023

  • 1. GemStone Update Norm Green and:[ James Foster ] ESUG 2023 Lyon, France August 30, 2023
  • 4. 4 Our History • 41 Years of Continuous Operation – Founded: 1982 (as Servio Logic Corporation) – First Version of GemStone Shipped: 1986 – Name Changed from Servio to GemStone: 1995 – Acquired by Brokat: July 2000 – Management buyout: June 2001 – Acquired by VMware: May 2010 – Acquired by GemTalk Systems: May 2013
  • 5. 5 Financial and Trading Vertical Kapital is the world leading derivatives trading and management system – since 1993 DBO is a very large precious metals trading and settlement system. - since 1990 ICE is the world’s fastest growing electronic trading exchange – since 1994 MMI Holdings – Financial portfolio management system. – since 1995 Lifeware – Cloud-based insurance management solutions – since 2000 Guava – Financial & treasury Software – since 1998 GemStone Powered Business
  • 6. 6 Manufacturing Vertical Works application for semiconductor manufacturing – since 1991 Semiconductor manufacturing software – since 1998 GemStone Powered Business HVAC software – since 2012 Adhesives Manufacturing – since 1997
  • 7. 7 Utilities Vertical TCMS II- Trouble Call Management System V2 GemStone Powered Business GemTalk provides remote administration and emergency on-call support to augment FPL staff
  • 8. 8 Telecommunications Vertical Telecom Service Provisioning for Argentina – since 2004 GemStone Powered Business CONDIS – Inventory and cable management – since 1993 Telecom Workflow Management – since 2013
  • 9. Government Vertical Border Security – since 1996 Visa Processing – since 2004 Dutch Agricultural Institute – agriculture data collection – since 1998 GemStone Powered Business
  • 11. 11 GemTalk In the Community… ▪ Conferences and Groups ▪ Pharo Consortium (Industrial Member) ▪ ESUG (Platinum Sponsor) ▪ FAST (Platinum Sponsor)
  • 13. 13 GemTalk – The Next Generation ▪ Welcome Kurt Kilpela! ▪ Joined GemTalk on May, 2019 ▪ From Kurt’s Cover Letter: Early in my education, I was introduced to Smalltalk. Prior to this, my training was in Java, C, and C++. Initially, it felt bizarre. In just a few days, I fell in love.
  • 14. 14 GemTalk – The Next Generation ▪ Welcome Andres Valloud! ▪ Joined GemTalk in June, 2022 ▪ Projects ▪ x86_64 native code generator improvements ▪ ARM aarch64 native code generator
  • 15. 15 GemTalk – The Next Generation ▪ Welcome Alissa Friel! ▪ Joined GemTalk in August, 2023 ▪ BSc. Computer Science, Portland State University
  • 16. Part 2 GemStone Software: A Lightning Tutorial
  • 17. 17 How Many Have A Good Feel For What GemStone Is? How Many Have Actually Used GemStone ?
  • 18. 18 So What Is This GemStone Thing? • A solution to the limitations of traditional Smalltalk: 1. Object space limited to one VM. 2. Object space limited to one host. 3. Object space limited to available RAM. 4. Object changes (since last image save) lost when VM exits.
  • 19. 19 Welcome To The World Of GemStone! • Object space visible to thousands of VMs on thousands of machines. • Object space limited by disk, not RAM. • Object changes managed by ACID transactions – Atomic – Consistent – Isolated – Durable • Object changes guaranteed persistent once committed.
  • 20. 20 Key Features Of GemStone • Scalability – Billions of objects – Thousands of users. – Thousands of machines. – Thousands of transactions per second. – Terabytes of data.
  • 21. 21 Key Features Of GemStone • Concurrency – Multiple user sessions. – Built-in database transactions. • Commit • Abort • Continue – Optimistic Concurrency • Reduced Conflict Collections – Pessimistic Concurrency • Object-level read/write locks. – Namespaces • Shared and private.
  • 22. 22 Key Features Of GemStone • Security – Object-level security. • User, group, world permissions. – Login Security • User-id / Password • Single-Sign-On (GSSAPI / Kerberos) • LDAP • PAM • X509 Certificate – Administrative Privileges • #GarbageCollection • #OtherPassword • #SystemControl
  • 23. 23 Key Features Of GemStone • 100% Smalltalk (“It’s turtles, all the way down”) – All objects, all the time. – Classes, methods, blocks, exceptions. – ANSI Smalltalk compliant
  • 24. 24 Key Features Of GemStone • Very Large Collection Support – Collections of millions of objects. – Optimized searches using b-tree Indexes: • Equality Indexes (a = b) – AllEmployees detect:{:each| each.lastName = ‘Ducasse’ } • Identity Indexes (a == b) – AllEmployees select:{:each| each.countryOfOrigin == #France }
  • 25. 25 Key Features Of GemStone • Interfaces to Other Smalltalks – VisualWorks® - GemBuilder for VisualWorks® – VA Smalltalk® - GemBuilder for VA Smalltalk® – Pharo – tODE, GsDevKit, Sparkle, gt4Gemstone – Jade / Jadeite (Dolphin, open source) • Interfaces To Other Languages – C/C++ - GemBuilder for C – Java – GemBuilder for Java • Interfaces to Relational Databases – Oracle – GemConnect for Oracle – Postgres – GemConnect for Postgres – Sybase – GemConnect for Sybase (open source)
  • 26. 26 GemStone/S 64 Platforms • Object Server (Database) – Linux: • x86_64 (Intel / AMD) • aarch64 (ARM) ** NEW ** (non-production only) – Apple MacOS: • x86_64 • M1, M2 (Apple Silicone) – Oracle Solaris: x86_64 – IBM: AIX PowerPC 64 bit – Raspberry Pi aarch64 • Object Clients – All of the above, and: • Microsoft Windows 10,11
  • 27. 27 GemBuilder for Smalltalk (GBS) Platforms • Cincom® VisualWorks® 9.1.1 – MS Windows 10/11 – Linux 32/64 bit • Instantiations VA Smalltalk™ 11.0.1, 10.0.2, 8.6.3 – MS Windows 10/11
  • 28. 28 Jade IDE • Open source IDE for all versions of GemStone • Written in Dolphin Smalltalk by James Foster • MS Windows only • Supports all versions of GemStone • Free of charge • Rich set of tools – Browsers – Inspectors – Debuggers • https://github.com/jgfoster/Jade
  • 30. 30 Jadeite IDE • Fork of the Jade project • Currently in development at GemTalk for a customer in Europe • Support for source code control with Rowan and Git • Support for Tonal file format • Migration tools from other SCM systems
  • 31. 31 GemStone/S Licensing Models • Community Editions – Free (as in beer) for any use (including commercial) • Perpetual – Buy once, own it forever • Annual Subscription – Pay annually, cancel any time. • Value Added Reseller (VAR) – Percentage of royalties
  • 32. 32 GemStone Community Edition Starter Limited Full Extended SPC Extended CPU Extended Full License Kind Perpetual Subscription Subscription Subscription Subscription Subscription Cores 2 2 2 2 4 4 SPC 1 G 2 G 2G 4G 2G 4G Gems 10 20 Unlimited Unlimited Unlimited Unlimited Disk 10G 50G Unlimited Unlimited Unlimited Unlimited Development DB Unlimited Unlimited Unlimited Unlimited Unlimited Unlimited Production DB 1 2 Unlimited Unlimited Unlimited Unlimited Tech Support Community Community 5 tickets 10 tickets 10 tickets 20 tickets Price Free Free $1500/yr $3000/yr $3000/yr $6000/yr Distribution With Product Email addr Sales Sales Sales Sales Source: http://gemtalksystems.com/index.php/lc-licensing/
  • 33. 33 Support Models • Web Support (24 x 7) – https://techsupport.gemtalksystems.com – Help requests processed 8 am – 5 pm Pacific Time • Emergency 24 x 7 Support – Available for a premium – GemTalk provides an emergency phone number – Call back to the customer within 15 minutes • Mailing Lists – GLASS – Open source projects: Seaside / GLASS / tODE – GemStone Smalltalk – GemStone-specific – Sign up at: • https://lists.gemtalksystems.com/mailman/listinfo/
  • 36. 36 Recent GS/64 Server Releases • Version 3.7.0 – August 2023 September 2023 • Version 3.7.1 – February 2024 • Version 3.6.x – 3.6.6: May 2023 – 3.6.7: December 2023
  • 37. 37 New In Version 3.6 • Support for DARE (Data At Rest Encryption) – Optional encryption of database extents and tranlogs – Encryption done at the database page level • Each page is encrypted individually – Encryption Mode: XTS-AES • XTS == XEX-based tweaked-codebook mode with ciphertext stealing • Support for 128 and 256 bit XTS keys • XTS is supported by: BestCrypt, TrueCrypt, VeraCrypt, DiskCryptor, MS Bitlocker, wolfCrypt. – Private key (and passphrase) required to start encrypted GemStone database.
  • 38. 38 New In Version 3.6 • Support for DARE (Data At Rest Encryption) – Encrypt / decrypt via copydbf utility • Creating an encrypted database extent: $GEMSTONE/bin/copydbf –e dbCert.pem –s 128 –K /home/normg/certs $GEMSTONE/data/extent0.dbf $GEMSTONE/data/extent0.sdbf • Starting an encrypted database: $GEMSTONE/bin/startstone –D dbPrivateKey.pem –J ~/secrets/passphrase.txt –K /home/normg/keys -z $GEMSTONE/data/system.conf normstone
  • 39. 39 New In Version 3.6 • Restricted System >>performOnServer: – If enabled, each UserProfile has a whitelist of permited performOnServer: commands. – Only commands on the whitelist may be executed. – Default whitelist is empty. – Example of adding a permitted command (git) |up| up := AllUsers userWithId: ‘normg’. up addPrivilege: ‘NoPerformOnServer’ ; addPerformOnServerCommands: (Array with: ‘/usr/bin/git’) .
  • 40. 40 New In Version 3.6 • 4 New Special Classes – Also known as immediate objects – Value encoded in the object ID – Never occupy disk space • SmallDate • SmallDateAndTime • SmallScaledDecimal • SmallTime
  • 41. 41 New In Version 3.6 • gslist output as JSON: normg@moop>gslist -j {"GemStoneServers":[ { "Name":"norm", "Host":"moop", "HostId":"b6f9ea8dee7eca73", "Ip":"10.94.141.31", "Status":"Exists", "Type":"Stone", "Version":"3.6.0", "Creator":"normg", "Started":"2020-09-21T12:44:59.000-07:00", "Pid": 7733, "Port": 38423, ….
  • 42. 42 New in Version 3.6 • Amazon AWS Customer Master Key (CMK) Support – Encrypted data stored in GemStone. – Encryption keys managed by AWS. – Cloud user controls if/when data is unlocked and accessed.
  • 43. 43 Version 3.7 • Performance, performance, performance! – We’ve made everything faster • startstone • stopstone • markForCollection • Backup • Restore • page reclaim • Smalltalk VM (thanks Andres!)
  • 44. 44 Version 3.7 • Support Monitoring GemStone with Prometheus – “Prometheus is an open-source systems monitoring and alerting toolkit originally built at SoundCloud. Since its inception in 2012, many companies and organizations have adopted Prometheus, and the project has a very active developer and user community. It is now a standalone open source project and maintained independently of any company.” - https://prometheus.io
  • 46. 46 Version 3.7 • Faster Smalltalk VM on x86_64 – Native code generator optimized by Andres Valloud – Reduce number of instructions and number of branches – Better branch prediction – Average ~35% improvement
  • 47. 47 Version 3.7 • Microsoft Azure Customer Master Key (CMK) Support – Encrypted data stored in GemStone. – Encryption keys managed by Azure.
  • 48. 48 Version 3.7 • Fast Instance Migration – Migrate and commit all instances of up to 2000 classes in a single operation. – Multi-threaded: uses multiple C threads for speed. – Typical Use Case: Add a new instance variable.
  • 49. 49 Version 3.7 • OpenSSL upgraded from v1.1.1x to version v3.0.x • ssh Support – New Class: GsSshSocket – Execute remote commands via ssh • sftp Support – New Classes: GsSftpSocket, GsSftpRemoteFile – Upload and download files via sftp
  • 50. 50 Version 3.7 • Faster Read Streams on Strings – New Class: ReadByteStream – Optimized for reading String and byte objects. • String Auto Promotion to Unicode16 – When a code point greater than 255 is added to a String, it is promoted to Unicode16.
  • 51. 51 Version 3.7 • New Cryptographic Hash Methods (to play nicer with Pharo…) – We can now a hash result as any of: • LargeInteger • String • ByteArray (new) ‘abc’ perform: #sha256Sum -Answers a String of hex digits ‘abc’ perform: #sha256SumBytes -Answers a ByteArray
  • 52. 52 Version 3.7 • Native Support for FileSystem – FileSystem is now included in the GemStone base image – Code ported from Pharo – Major Classes • FileReference • FileSystem • FileLocator • FsFileDescriptor
  • 53. 53 Version 3.7 • New GsSecureSocket features: – GsSecureSocket == GemStone’s TLS Socket Interface – Pre-shared keys (PSK) • Connect using a secret known to both the client and server. – Anonymous TLS • Encrypted connection with no authentication
  • 54. 54 Version 3.7 • Customer-defined Special (Immediate) Objects – 16 new Immediate classes for use by customers – Each instance stores up to 56 bits of customer-defined data – Example: Money • Currency (4 bits): – Euro – US$ – CAN$ – Yen • Amount (52 bits) – Answers a Scaled Decimal • Example code shipped in: – $GEMSTONE/examples/smalltalk/Money.gs
  • 55. 55 Version 3.7 • One-time Passwords – Create a temporary password valid for a single login. – Password lifetime specified in seconds. – Example: GsCurrentSession currentSession createOneTimePasswordForUserId: ‘NormG’ validForSeconds: 60
  • 56. 56 Version 3.7 • Rowan – GemStone’s New Package Manager – Preview Version Only. – Talk to Dale
  • 57. 57 Version 3.7.1 • Native Code Support on Linux ARM64 – 3.7.0 supports only interpreted mode • Still More VM improvements on Linux x86_64 – Thanks Again Andres! • Bug fixes
  • 58. 58 Version 3.8 and Beyond… • Native ROWAN support – ROWAN is a new package manager that supports FileTree and Tonel repositories. – https://github.com/GemTalk/Rowan • Pharo Support (Sparkle) – Not GBS for Pharo – Inspectors and debuggers – Work In progress. – https://github.com/GemTalk/Sparkle – No GA date yet. – Martin’s UK Smalltalk talk: https://vimeo.com/676889959 – More in Martin McClure’s talk Thursday @ 9 am
  • 59. 59 New Open-Source Projects • Jadite For Pharo – Pharo IDE for GemStone Code Development Using Rowan – Work in progress, NOT ready for prime-time – Talk to Dale • https://github.com/GemTalk/JadeiteForPharo
  • 60. 60 New Open-Source Projects • GemConnect for Postgres – 100% Smalltalk code via FFI – Requires GemStone/64 v3.6.2 or later – Available as open source on github: • https://github.com/GemTalk/GemConnect-for-Postgres • GemConnect for RabbitMQ – 100% Smalltalk code via FFI – Requires GemStone/64 v3.6.4 or later – Available as open source on github: • https://github.com/GemTalk/GemConnectForRabbitMQ
  • 61. Questions? 61 GemTalk Systems LLC 15220 NW Greenbrier Pkwy., Suite 240 Beaverton, Oregon, 97006 Mobile: (503) 804-2041 norm.green@gemtalksystems.com Norman R. Green Senior VP & Chief Technical Officer www.gemtalksystems.com ®