Smartgears

Fabio Simeoni (FAO)
Lucio Lelii (CNR)
Andrea Manzi (CERN)
SmartGears
invisible software
Monday, 14 October 13

2
“a set of Java libraries that turn
Servlet-compliant containers and applications
into gCube resources, transparently.”
gCube Wiki

3
turn software and containers
into gCube resources

3
turn software and containers
into gCube resources
what does it mean ?

4
“Software-as-Resource”

4
“Software-as-Resource”
software we can manage.

5
software we can discover
use without hardcoded knowledge

5
monitor and control
take actions when not operational

5
monitor and control
take actions when not operational
dedicate to user groups
change policies, assign roles

6
“Container-as-Resource”
gCube Hosting Nodes

6
“Container-as-Resource”
same goals, same requirements
publication and discovery
lifecycle management
resource sharing
gCube Hosting Nodes

7
management tasks
compile and publish descriptions
track and change status
enforce policies

7
management tasks
enforce policies
human solutions
not practical, often impossible

7
management tasks
enforce policies
human solutions
not practical, often impossible
automated solutions
local enabling software, remotely controlled

8
status quo
the gCube Core Framework

8
status quo
produces SaR
software built to be managed

8
status quo
produces SaR
software built to be managed
speciﬁcally and exclusively for gCube.

9
a closed world
a place where to build gCube

9
a closed world
has been good
consistent, massive growth

9
a closed world
has been good
consistent, massive growth
now it’s bad.

10
can’t manage external software
not in gCube, not a SaR

10
can’t reuse gCube software
in gCube, in gCube only

10
little incentive to build SaR
can’t reuse gCube software
in gCube, in gCube only
: closed worlds have locks

11
one type of SaR
legacy JAX-RPC
no JAX-RS, JAX-WS, or other “hot” techs

11
one type of SaR
legacy JAX-RPC
for one container
Globus/Axis
no web containers, no app servers

11
one type of SaR
legacy JAX-RPC
for one container
Globus/Axis
no web containers, no app servers
little technical evolution for gCube
: closed worlds become stale

12
the age problem
long perceived

12
the age problem
long perceived
misguided facelifts
myopic, prohibitively expensive

13
the visibility problem
top of the stack, in the middle of design

13
creates locks
can’t work without them

13
creates locks
can’t work without them
can’t easily replace them
locks rust over time

14
SmartGears
invisible software

14
gCube resources, without locks.
SmartGears
invisible software

15
installs in any Servlet container
entirely specs-driven

15
installs in any Servlet container
entirely specs-driven
wakes up when apps do
considers only apps that carry a SaR “badge”

16
a “corolla” of manager components
injects logic in app/request lifecycles

16
listening for remote instructions
extends application API

16
listening for remote instructions
extends application API
if it runs at least one SaR, or until it does
keeps books for the container

17
container

17
container app

17
container app SaR

17
container app SaR SmartGears

17
install

startup-ignore
17

startup-manage
17

api-extend
17

container-manage
17

18
SmartGears like FWS
overlapping sets of “microlibs”

18
SmartGears like FWS
dual roles
make resources vs. call resources

18
SmartGears like FWS
common theme
quarantine legacy
dual roles

18
SmartGears like FWS
common theme
quarantine legacy
visible stack vs. invisible runtime
diﬀerent nature
dual roles

19
what, why, how, quick tour.

20
a few demands.

20
a few demands.
Servlet 3
all the right hooks

20
a few demands.
Servlet 3
all the right hooks
container descriptor
$GHN_HOME/container.xml

20
a few demands.
Servlet 3
all the right hooks
container descriptor
$GHN_HOME/container.xml
application descriptor
WEB-INF/gcube-app.xml

21
<container mode='online'>
<hostname>acme.org</hostname>
<port>8081</port>
<infrastructure>gcube</infrastructure>
<vo>devsec</vo>
<vo>devNext</vo>
<persistence>some/alternative/location</persistence>
<site>
<country>it</country>
<location>rome</location>
<latitude>41.9000</latitude>
<longitude>12.5000</longitude>
</site>
<property name='prop1' value='val1' />
<property name='prop2' value='val2' />
<publication-frequency>60</publication-frequency>
</container>
container.xml

22
<application mode="online">
<name>lorem</name>
<group>ipsum</group>
<version>1.0</version>
<description>Lorem ipsum dolor sit amet...</description>
<persistence>/some/custom/location</persistence>
<exclude>/some/app/url</exclude>
<exclude>/some/other/custom/url</exclude>
</application>
gcube-app.xml

23
the tarball
smartgears-distribution.tar.gz
(Maven, Wiki)

23
the tarball
(Maven, Wiki)
install, upgrade, maintain
libraries, scripts, conﬁg, apps

23
the tarball
(Maven, Wiki)
install, upgrade, maintain
libraries, scripts, conﬁg, apps
follow admin guide.

24
“microlibs”
unobtrusive tooling

24
“microlibs”
narrow focus, no popular deps
single-minded, stand-alone
unobtrusive tooling

24
“microlibs”
narrow focus, no popular deps
single-minded, stand-alone
modular, made-to-measure assemblies
yet gregarious
unobtrusive tooling

25
common-smartgears

25
common-smartgears
common-events
common-validator
common-scope
registry-publisher
common-gcore-resources
common-smartgears-app
common-conﬁguration-scanner
common-scope-maps
discovery-client
ic-client
common-gcore-stubs

26
shared deployment
outside and visible to all apps

26
shared deployment
shared container state
easy and lean app packaging
node consistency and upgrades
some advantages

26
shared deployment
shared container state
easy and lean app packaging
node consistency and upgrades
some advantages
version-clashes harder to handle
much caution

09:50:17.031 [http-bio-8080-exec-2] INFO ContainerManager: starting container management
09:50:17.037 [http-bio-8080-exec-2] TRACE Provider: reading container configuration @ /Users/fabio/workspaces/indigo/smartgears-testparty/
smartgears-webapp/ghn-home/container.x$
09:50:17.108 [http-bio-8080-exec-2] TRACE Provider: setting persistence location for container @ /Users/fabio/workspaces/indigo/smartgears-
testparty/smartgears-webapp/ghn-home/$
09:50:17.130 [http-bio-8080-exec-2] TRACE ContainerManager: managing container lifecycle with [profile-management]
09:50:17.132 [http-bio-8080-exec-2] INFO ProfileManager: loading container profile @ /Users/fabio/workspaces/indigo/smartgears-testparty/
smartgears-webapp/ghn-home/state/ghn.x$
09:50:17.222 [http-bio-8080-exec-2] INFO ProfileBuilder: updating ghn profile
09:50:17.246 [http-bio-8080-exec-2] TRACE ProfileManager: sharing container profile
09:50:17.252 [http-bio-8080-exec-2] TRACE Lifecycle: container transitioned from started to active
09:50:17.254 [http-bio-8080-exec-2] INFO Bootstrap: starting management of application @ /test-app
09:50:17.255 [pool-1-thread-1] INFO ProfilePublisher: publishing container in scopes [/gcube, /gcube/devsec, /gcube/devNext]
09:50:17.256 [pool-1-thread-4] TRACE ProfileManager: storing container profile @ /Users/fabio/workspaces/indigo/smartgears-testparty/
smartgears-webapp/ghn-home/state/ghn.xml
09:50:17.266 [http-bio-8080-exec-2] TRACE ApplicationConfiguration: setting persistence location for test-app @ /Users/fabio/workspaces/indigo/
smartgears-testparty/smartgears-w$
09:50:17.271 [http-bio-8080-exec-2] TRACE Provider: test-app uses the default lifecycle as it does not include /WEB-INF/gcube-handlers.xml
09:50:17.286 [http-bio-8080-exec-2] TRACE Provider: test-app uses default extensions as it does not include /WEB-INF/gcube-extensions.xml
09:50:17.299 [http-bio-8080-exec-2] TRACE ApplicationManager: managing test-app lifecycle with [profile-management]
09:50:17.299 [http-bio-8080-exec-2] TRACE ApplicationManager: managing test-app requests with [request-validation]
27
logging
so simple, so hard

28
with container and app logs
no interference

28
no interference
the only externals
slf4j + logback

28
no interference
the only externals
slf4j + logback
when apps make same choice
diﬃcult cases

28
no interference
the only externals
slf4j + logback
when apps make same choice
diﬃcult cases
and yet we are ok.

29
servlets for remote management
API extensions

29
servlets for remote management
API extensions
GET /
GET /proﬁle
GET /conﬁguration
GET /lifecycle
POST /lifecycle
GET /scopes
POST scopes
...<app-root>/gcube/resource...

31
from app to resource with a conﬁg ﬁle
gCube-agnostic apps

31
the fabric of gCube
gCube-aware apps
gCube-agnostic apps

31
the fabric of gCube
gCube-aware apps
inspect, subscribe, react
born to be resources
gCube-agnostic apps

31
the fabric of gCube
gCube-aware apps
inspect, subscribe, react
born to be resources
SmartGears must become visible.
gCube-agnostic apps

32
via ServletContext
partial API exposure

32
via ServletContext
access to information and events
(Application|Container) Context

32
via ServletContext
access to information and events
(Application|Container) Context
interface ApplicationContext {
ApplicationConfiguration configuration();
T profile(Class<T> type);
ApplicationLifecycle lifecycle();
Hub events();
Persistence persistence();
ContainerContext container();
Properties properties();
}
interface ContainerContext {
ContainerConfiguration configuration();
T profile(Class<T> type);
ContainerLifecycle lifecycle();
Hub events();
Persistence persistence();
Properties properties();
}

33
easy access to ApplicationContext

33
Servlet 3 @WebListener
adds startup listener to app

33
a ContextProvider
injects context in a static factory

33
ApplicationContext = ContextProvider.get()
a ContextProvider
injects context in a static factory

34
BOM-driven
Maven dependencies

34
BOM-driven
Maven dependencies
<dependency>
<groupId>org.gcube.distribution</groupId>
<artifactId>maven-smartgears-bom</artifactId>
<version>LATEST</version>
<type>pom</type>
<scope>import</scope>
</dependency>
<dependency>
<groupId>org.gcube.core</groupId>
<artifactId>common-smartgears-app</artifactId>
</dependency>
<dependency>
<groupId>org.gcube.core</groupId>
<artifactId>common-smartgears</artifactId>
</dependency>

35
beautifully private.
design internals

35
design internals
bootstrap, managers, lifecycle,
contexts, events, validation
handler/extension APIs
hollow kernel

35
design internals
hollow kernel
implementations are conﬁgured
defaults can be (en|dis)-abled, inﬁnitely extensible
dynamically populated

35
design internals
hollow kernel
implementations are conﬁgured
defaults can be (en|dis)-abled, inﬁnitely extensible
dynamically populated
embedded Tomcat
dedicated test framework

36
gCube calls to SmartGears apps
FWS alignment

36
FWS alignment
abstract call interceptors
common-gcube-calls

36
FWS alignment
common-gcube-calls
bridge for JAX-WS stack
common-jaxws-calls

36
FWS alignment
common-gcube-calls
bridge for JAX-WS stack
common-jaxws-calls
only gCube-aware clients
CLs, portlets
with limitations

37
common-gcore-clients common-fw-clients common-generic-clients
FeatherWeight StackgCore Stack
service service service
common--clients
common--gcube-calls
common--jaxws-calls
gCore Servlet
WP 11
WP 8
WP 8

37
common-generic-clients
CL alignment
common-gcore-clients common-fw-clients common-generic-clients
FeatherWeight StackgCore Stack
service service service
common--clients
common--gcube-calls
common--jaxws-calls
gCore Servlet
WP 11
WP 8
WP 8

38
October 2013
SmartGears 1.0.0

38
October 2013
SmartGears 1.0.0
co-released with 2 in FWS, 1 for CLs
6 new components

38
October 2013
SmartGears 1.0.0
co-released with 2 in FWS, 1 for CLs
6 new components
TDS service
(JAXWS)
one early adopter

39
what comes next

39
gCube catches up.
what comes next

40
adoptions
FAO and NKUA apps await

40
adoptions
Web Hosting Manager
the new gHN Manager

40
adoptions
Web Hosting Manager
the new gHN Manager
enabling alignment
gCore vs. SmartGears forks

41
gCube-agnostic clients
best-eﬀort magic

41
best-eﬀort magic
dynamic deployment
totally revisited

41
best-eﬀort magic
new resource model
SmartGears as launch platform
dynamic deployment
totally revisited

42
exciting times.

42
exciting times.
ﬁnd more in dev guide.

43
to George K.
who was right all along.

Smartgears

Recommended

Recommended

More Related Content

What's hot

What's hot (15)

Similar to Smartgears

Similar to Smartgears (20)

More from Fabio Simeoni

More from Fabio Simeoni (10)

Recently uploaded

Recently uploaded (20)

Smartgears