SlideShare a Scribd company logo
1 of 32
Download to read offline
Dynamic C++
POCOC++ PORTABLE COMPONENTS
alex@pocoproject.org
Sunday, October 7, 12
Content
> The Problem
> The Solution
> The Anatomy of the Solution
> The Heart and Soul of the Solution
> Let’s Dance - code example
> Other solutions
> Performance and comparisons
> Conclusion
Sunday, October 7, 12
"Without a good library,most
interesting tasks are hard to do in C++;
but given a good library,almost any
task can be made easy."
Bjarne Stroustrup
(designer and original implementor of C++)
Sunday, October 7, 12
A Brief History of Data Access
Sunday, October 7, 12
Data Formats
> often in proprietary binary format
> transform into character strings of desired format
> server-side needs an equivalent of HTML rendering engine
Sunday, October 7, 12
So,how do we do this?
> generate the desired format in the database :-
> use dynamic language
> mix HTML with server-side code and compile on the fly (shudder)
> browser plugin (double-shudder)
> or ... use static language on the server-side and AJA(X|J) in the browser?
Sunday, October 7, 12
SELECT * FROM Simpsons
> discover column count
The Problem
> discover column data types
> bind returned data to variables
Sunday, October 7, 12
SQLRETURN rc;
SQLHENV henv = SQL_NULL_HENV;
SQLHDBC hdbc = SQL_NULL_HDBC;
SQLHSTMT hstmt = SQL_NULL_HSTMT;
rc = SQLAllocHandle(SQL_HANDLE_ENV, SQL_NULL_HANDLE, &henv);
odbc_check_env (rc, henv);
rc = SQLSetEnvAttr(henv, SQL_ATTR_ODBC_VERSION, (SQLPOINTER) SQL_OV_ODBC3, 0);
odbc_check_env (rc, henv);
rc = SQLAllocHandle(SQL_HANDLE_DBC, henv, &hdbc);
odbc_check_dbc (rc, hdbc);
SQLCHAR connectOutput[1024] = {0};
SQLSMALLINT result;
rc = SQLDriverConnect(hdbc,NULL,(SQLCHAR*)dbConnString.c_str(),(SQLSMALLINT)SQL_NTS,connectOutput,sizeof(connectOutput),&result,SQL_DRIVER_NOPROMPT);
odbc_check_dbc (rc, hdbc);
sql = "SELECT * FROM Simpsons";
SQLCHAR* pStr = (SQLCHAR*) sql.c_str();
rc = SQLPrepare(hstmt, pStr, (SQLINTEGER) sql.length());
odbc_check_stmt (rc, hstmt);
char name[50] = { 0 };
SQLLEN lengths[3] = { 0 };
int age = 0;
float weight = 0.0f;
std::memset(&sixth, 0, sizeof(sixth));
rc = SQLBindCol(hstmt, (SQLUSMALLINT) 1, SQL_C_CHAR, (SQLPOINTER) chr, (SQLINTEGER) sizeof(chr[0]), &lengths[0]);
odbc_check_stmt (rc, hstmt);
rc = SQLBindCol(hstmt, (SQLUSMALLINT) 2, SQL_C_INTEGER, (SQLPOINTER) &age, (SQLINTEGER) sizeof(age), &lengths[1]);
odbc_check_stmt (rc, hstmt);
rc = SQLBindCol(hstmt, (SQLUSMALLINT) 3, SQL_C_BINARY, (SQLPOINTER) &weight, (SQLINTEGER) sizeof(weight), &lengths[2]);
odbc_check_stmt (rc, hstmt);
printf(“Name: %s, Age: %d, Weight: %f”, name, age, weight);
! !
“solution”
© mark du toit
Sunday, October 7, 12
using namespace Poco::Data::SQLite;
int main()
{
Session session("SQLite", "simpsons.db");
std::cout << RecordSet(session,
"SELECT * FROM Simpsons");
return 0;
}
The Solution
© mark du toit
Sunday, October 7, 12
Statement stmt =
(session << "SELECT * FROM Simpsons", now);
RecordSet rs(stmt);
ostream& operator << (ostream &os,
const RecordSet& rs)
{
return rs.copy(os);
}
The Anatomy of the Solution
(step - by - step)
Sunday, October 7, 12
The Anatomy of the Solution
(under the hood)
using namespace std;
ostream& RecordSet::copy(ostream& os, size_t offset = 0, size_t length = END)
{
RowFormatter& rf = (*_pBegin)->getFormatter();
os << rf.prefix();
copyNames(os);
copyValues(os, offset, length);
os << rf.postfix();
return os;
}
ostream& RecordSet::copyValues(ostream& os, size_t offset, size_t length)
{
RowIterator begin = *_pBegin + offset;
RowIterator end = (RowIterator::END != length) ? it + length : *_pEnd;
std::copy(begin, end, std::ostream_iterator<Row>(os));
return os;
}
Sunday, October 7, 12
Row& RowIterator::operator * ()
{
if (END == _position)
throw InvalidAccessException("End of iterator reached.");
return _pRecordSet->row(_position);
}
ostream& operator << (ostream &os, const Row& row)
{
os << row.valuesToString();
return os;
}
const string& Row::valuesToString() const
{
return _pFormatter->formatValues(values(), _valueStr);
}
The Anatomy of the Solution,contd.
(STL - compliance)
Sunday, October 7, 12
class Row
{
public:
// ...
template <typename T>
void set(size_t pos, const T& val)
{
try { _values.at(pos) = val; }
catch (out_of_range&)
{ throw RangeException("Invalid column."); }
}
// ...
private:
vector<Poco::Dynamic::Var> _values;
};
The Heart of the Solution
(Row::set)
Sunday, October 7, 12
namespace Poco {
namespace Dynamic {
class Var
{
public:
// ...
template <typename T>
Var(const T& val):
_pHolder(new VarHolderImpl<T>(val))
{
}
// ...
private:
VarHolder* _pHolder;
};
} }
The Soul of the Machine
(Poco::Dynamic::Var)
* Design based on boost::any
Sunday, October 7, 12
So,where was boost::any found lacking ?
It’s a great idea with limited applicability -
dynamic on receiving,but static on the giving end.
using boost::any;
using boost::any_cast;
typedef std::list<any> many;
int ival = 42;
std::string sval = “fourty two”;
values.push_back(ival);
values.push_back(sval);
std::string sival = values[0]; // oops!, compile error
sival = any_cast<std::string>(values[0]); // still oops!, throw
Sunday, October 7, 12
Var in Practical Use
std::string s1("string");
Poco::Int8 s2(23);
std::vector<Var> s16;
s16.push_back(s1);
s16.push_back(s2);
Var a1(s16);
std::string res = a1.convert<std::string>();
// ["string", 23]
DynamicStruct aStruct;
aStruct["First Name"] = "Junior";
aStruct["Last Name"] = "POCO";
aStruct["Age"] = 1;
Var a1(aStruct);
std::string res = a1.convert<std::string>();
// { "Age”: 1, "First Name": "Junior", "Last Name" : "POCO" }
std::string str("42");
Var v1 = str; // "42"
double d = v1; // 42.0
Var v2 = d + 1.0; // 43.0
float f = v2 + 1; // 44.0
Sunday, October 7, 12
What Else is in the Var Box
> Dynamic array, pair and struct (map) support
(Poco::Dynamic::Pair/Struct)
> JSON (de)serialization of the above
> Empty value support (very handy with null DB fields)
> Strict conversion checks
Sunday, October 7, 12
namespace Poco {
namespace Dynamic {
class VarHolder
{
public:
virtual ~VarHolder();
virtual void convert(int& val) const;
// ...
protected:
VarHolder();
// ...
};
template <typename T> // for end-user extensions
class VarHolderImpl: public VarHolder
{
//...
};
template <> // native and frequently used types specializations provided by POCO
class VarHolderImpl<int>: public VarHolder
{
//...
};
//...
}}
The Soul of the Machine
(Poco::Dynamic::VarHolder)
Sunday, October 7, 12
Poco::Net::HTTPServer
The Machine Assembled
RecordSetStatement
RowFormatter
Session
Poco::Dynamic::Var
Sunday, October 7, 12
Let’s Dance
class DataRequestHandler: public HTTPRequestHandler
{
public:
void handleRequest(HTTPServerRequest& request,
HTTPServerResponse& response)
{
response.setChunkedTransferEncoding(true);
response.setContentType("text/xml");
ostream& ostr = response.send();
Session sess("SQLite", "sample.db");
ostr << RecordSet(sess,
"SELECT * FROM Simpsons",
new XMLFormatter);
}
};
Sunday, October 7, 12
A Real World Example
Sunday, October 7, 12
Is it REALLY Dynamic?
Of course not.
Dig deep enough and there is no such thing as
dynamic.
Type handlers are templates,hence generated
by compiler and statically checked for type.
Sunday, October 7, 12
And there’s a price to pay ...
Binary sizes:
============
Linux
-----
5160 AnySize.o
23668 DynamicAnySizeExtract.o
25152 DynamicAnySizeConvert.o
9600 lexical_cast_size.o
Windows
-------
26,924 AnySize.obj
96,028 DynamicAnySizeExtract.obj
103,943 DynamicAnySizeConvert.obj
84,217 lexical_cast_size.obj
Lines of code:
=============
Any 145
DynamicAny* 3,588
lexical_cast 971
Sunday, October 7, 12
struct Person
{
std::string name;
std::string address;
int age;
};
But what if I need performance?
There is,of course,a lean and elegant static workaround.
In fact,several of them ...
Sunday, October 7, 12
namespace Poco {
namespace Data {
template <>
class TypeHandler<Person>
{
public:
static std::size_t size()
{
return 3;
}
static void bind(size_t pos, const Person& person, AbstractBinder* pBinder, Direction dir)
{
TypeHandler<std::string>::bind(pos++, person.name, pBinder, dir);
TypeHandler<std::string>::bind(pos++, person.address, pBinder, dir);
TypeHandler<int>::bind(pos++, person.age, pBinder, dir);
}
static void extract(size_t pos, Person& person, const Person& deflt, AbstractExtractor* pE)
{
TypeHandler<std::string>::extract(pos++, person.name, deflt.name, pExtr);
TypeHandler<std::string>::extract(pos++, person.address, deflt.address, pExtr);
TypeHandler<int>::extract(pos++, person.age, deflt.age, pExtr);
}
};
} }
Scaffolding - wrap Person into a TypeHandler
Sunday, October 7, 12
Person person =
{
"Bart Simpson",
"Springfield",
12
};
session << "INSERT INTO Person VALUES(?, ?, ?)", use(person);
std::vector<Person> people;
session << "SELECT Name, Address, Age FROM Person",into(people), now;
And Life is Good Again
std::string name, address;
int age;
session << "INSERT INTO Person VALUES(?, ?, ?)",
use(name),
use(address),
use(age);
Sunday, October 7, 12
using namespace std;
using namespace Poco;
typedef Tuple<string, string, int> Person;
typedef vector<Person> People;
People people;
people.push_back(Person("Bart Simpson", "Springfield", 12));
people.push_back(Person("Lisa Simpson", "Springfield", 10));
session << "INSERT INTO Person VALUES(?, ?, ?)", use(people), now;
people.clear();
session << "SELECT Name, Address, Age FROM Person", into(people), now;
But wait,there’s more!
Sunday, October 7, 12
What else is out there ?
> void*
> C union
> MS COM Variant
> boost::variant
> boost::lexical_cast
> boost::type_erasure
> folly::dynamic
Sunday, October 7, 12
Linux Performance Windows
Sunday, October 7, 12
ACCU Overload Journal Articles
http://accu.org/index.php/journals/1511
http://accu.org/index.php/journals/1502
Sunday, October 7, 12
Last but not Least
POCO
> large, comprehensive, well-designed framework
> designed for practical everyday use, with end-user in mind
> makes C++ programming fun
> 100% standard C++
> not reinventing the wheel (except when necessary ;-)
http://poco.svn.sourceforge.net/viewvc/poco/poco/trunk
https://poco.svn.sourceforge.net/svnroot/poco/poco/trunk
http://pocoproject.org
Sunday, October 7, 12
got POCO?C++ PORTABLE COMPONENTS
http://pocoproject.org alex@pocoproject.org
Sunday, October 7, 12

More Related Content

What's hot

Writing SOLID C++ [gbgcpp meetup @ Zenseact]
Writing SOLID C++ [gbgcpp meetup @ Zenseact]Writing SOLID C++ [gbgcpp meetup @ Zenseact]
Writing SOLID C++ [gbgcpp meetup @ Zenseact]Dimitrios Platis
 
Concurrency Concepts in Java
Concurrency Concepts in JavaConcurrency Concepts in Java
Concurrency Concepts in JavaDoug Hawkins
 
The Ring programming language version 1.3 book - Part 84 of 88
The Ring programming language version 1.3 book - Part 84 of 88The Ring programming language version 1.3 book - Part 84 of 88
The Ring programming language version 1.3 book - Part 84 of 88Mahmoud Samir Fayed
 
Алексей Кутумов, Вектор с нуля
Алексей Кутумов, Вектор с нуляАлексей Кутумов, Вектор с нуля
Алексей Кутумов, Вектор с нуляSergey Platonov
 
The Rust Programming Language: an Overview
The Rust Programming Language: an OverviewThe Rust Programming Language: an Overview
The Rust Programming Language: an OverviewRoberto Casadei
 
Kirk Shoop, Reactive programming in C++
Kirk Shoop, Reactive programming in C++Kirk Shoop, Reactive programming in C++
Kirk Shoop, Reactive programming in C++Sergey Platonov
 
Fun with Lambdas: C++14 Style (part 2)
Fun with Lambdas: C++14 Style (part 2)Fun with Lambdas: C++14 Style (part 2)
Fun with Lambdas: C++14 Style (part 2)Sumant Tambe
 
Compose Async with RxJS
Compose Async with RxJSCompose Async with RxJS
Compose Async with RxJSKyung Yeol Kim
 
(Greach 2015) Dsl'ing your Groovy
(Greach 2015) Dsl'ing your Groovy(Greach 2015) Dsl'ing your Groovy
(Greach 2015) Dsl'ing your GroovyAlonso Torres
 
Coscup2021-rust-toturial
Coscup2021-rust-toturialCoscup2021-rust-toturial
Coscup2021-rust-toturialWayne Tsai
 
Beginning direct3d gameprogrammingcpp02_20160324_jintaeks
Beginning direct3d gameprogrammingcpp02_20160324_jintaeksBeginning direct3d gameprogrammingcpp02_20160324_jintaeks
Beginning direct3d gameprogrammingcpp02_20160324_jintaeksJinTaek Seo
 
Coscup2021 - useful abstractions at rust and it's practical usage
Coscup2021 - useful abstractions at rust and it's practical usageCoscup2021 - useful abstractions at rust and it's practical usage
Coscup2021 - useful abstractions at rust and it's practical usageWayne Tsai
 
C++totural file
C++totural fileC++totural file
C++totural filehalaisumit
 

What's hot (20)

Writing SOLID C++ [gbgcpp meetup @ Zenseact]
Writing SOLID C++ [gbgcpp meetup @ Zenseact]Writing SOLID C++ [gbgcpp meetup @ Zenseact]
Writing SOLID C++ [gbgcpp meetup @ Zenseact]
 
Groovy
GroovyGroovy
Groovy
 
Concurrency Concepts in Java
Concurrency Concepts in JavaConcurrency Concepts in Java
Concurrency Concepts in Java
 
Blazing Fast Windows 8 Apps using Visual C++
Blazing Fast Windows 8 Apps using Visual C++Blazing Fast Windows 8 Apps using Visual C++
Blazing Fast Windows 8 Apps using Visual C++
 
Why rust?
Why rust?Why rust?
Why rust?
 
The Ring programming language version 1.3 book - Part 84 of 88
The Ring programming language version 1.3 book - Part 84 of 88The Ring programming language version 1.3 book - Part 84 of 88
The Ring programming language version 1.3 book - Part 84 of 88
 
Алексей Кутумов, Вектор с нуля
Алексей Кутумов, Вектор с нуляАлексей Кутумов, Вектор с нуля
Алексей Кутумов, Вектор с нуля
 
The Rust Programming Language: an Overview
The Rust Programming Language: an OverviewThe Rust Programming Language: an Overview
The Rust Programming Language: an Overview
 
Rust ⇋ JavaScript
Rust ⇋ JavaScriptRust ⇋ JavaScript
Rust ⇋ JavaScript
 
Lambda expressions in C++
Lambda expressions in C++Lambda expressions in C++
Lambda expressions in C++
 
Kirk Shoop, Reactive programming in C++
Kirk Shoop, Reactive programming in C++Kirk Shoop, Reactive programming in C++
Kirk Shoop, Reactive programming in C++
 
Fun with Lambdas: C++14 Style (part 2)
Fun with Lambdas: C++14 Style (part 2)Fun with Lambdas: C++14 Style (part 2)
Fun with Lambdas: C++14 Style (part 2)
 
Compose Async with RxJS
Compose Async with RxJSCompose Async with RxJS
Compose Async with RxJS
 
Python GC
Python GCPython GC
Python GC
 
(Greach 2015) Dsl'ing your Groovy
(Greach 2015) Dsl'ing your Groovy(Greach 2015) Dsl'ing your Groovy
(Greach 2015) Dsl'ing your Groovy
 
V8
V8V8
V8
 
Coscup2021-rust-toturial
Coscup2021-rust-toturialCoscup2021-rust-toturial
Coscup2021-rust-toturial
 
Beginning direct3d gameprogrammingcpp02_20160324_jintaeks
Beginning direct3d gameprogrammingcpp02_20160324_jintaeksBeginning direct3d gameprogrammingcpp02_20160324_jintaeks
Beginning direct3d gameprogrammingcpp02_20160324_jintaeks
 
Coscup2021 - useful abstractions at rust and it's practical usage
Coscup2021 - useful abstractions at rust and it's practical usageCoscup2021 - useful abstractions at rust and it's practical usage
Coscup2021 - useful abstractions at rust and it's practical usage
 
C++totural file
C++totural fileC++totural file
C++totural file
 

Similar to Dynamic C++ Silicon Valley Code Camp 2012

Refactoring to Macros with Clojure
Refactoring to Macros with ClojureRefactoring to Macros with Clojure
Refactoring to Macros with ClojureDmitry Buzdin
 
2 BytesC++ course_2014_c3_ function basics&parameters and overloading
2 BytesC++ course_2014_c3_ function basics&parameters and overloading2 BytesC++ course_2014_c3_ function basics&parameters and overloading
2 BytesC++ course_2014_c3_ function basics&parameters and overloadingkinan keshkeh
 
Example R usage for oracle DBA UKOUG 2013
Example R usage for oracle DBA UKOUG 2013Example R usage for oracle DBA UKOUG 2013
Example R usage for oracle DBA UKOUG 2013BertrandDrouvot
 
CouchDB Mobile - From Couch to 5K in 1 Hour
CouchDB Mobile - From Couch to 5K in 1 HourCouchDB Mobile - From Couch to 5K in 1 Hour
CouchDB Mobile - From Couch to 5K in 1 HourPeter Friese
 
ComputeFest 2012: Intro To R for Physical Sciences
ComputeFest 2012: Intro To R for Physical SciencesComputeFest 2012: Intro To R for Physical Sciences
ComputeFest 2012: Intro To R for Physical Sciencesalexstorer
 
Paradigmas de programação funcional + objetos no liquidificador com scala
Paradigmas de programação funcional + objetos no liquidificador com scalaParadigmas de programação funcional + objetos no liquidificador com scala
Paradigmas de programação funcional + objetos no liquidificador com scalaBruno Oliveira
 
RR & Docker @ MuensteR Meetup (Sep 2017)
RR & Docker @ MuensteR Meetup (Sep 2017)RR & Docker @ MuensteR Meetup (Sep 2017)
RR & Docker @ MuensteR Meetup (Sep 2017)Daniel Nüst
 
PostgreSQL Open SV 2018
PostgreSQL Open SV 2018PostgreSQL Open SV 2018
PostgreSQL Open SV 2018artgillespie
 
Nosql hands on handout 04
Nosql hands on handout 04Nosql hands on handout 04
Nosql hands on handout 04Krishna Sankar
 
A New Chapter of Data Processing with CDK
A New Chapter of Data Processing with CDKA New Chapter of Data Processing with CDK
A New Chapter of Data Processing with CDKShu-Jeng Hsieh
 
Getting started with ES6
Getting started with ES6Getting started with ES6
Getting started with ES6Nitay Neeman
 
Full-Stack JavaScript with Node.js
Full-Stack JavaScript with Node.jsFull-Stack JavaScript with Node.js
Full-Stack JavaScript with Node.jsMichael Lehmann
 
Next Generation Indexes For Big Data Engineering (ODSC East 2018)
Next Generation Indexes For Big Data Engineering (ODSC East 2018)Next Generation Indexes For Big Data Engineering (ODSC East 2018)
Next Generation Indexes For Big Data Engineering (ODSC East 2018)Daniel Lemire
 
NVIDIA HPC ソフトウエア斜め読み
NVIDIA HPC ソフトウエア斜め読みNVIDIA HPC ソフトウエア斜め読み
NVIDIA HPC ソフトウエア斜め読みNVIDIA Japan
 
Vitalii Bondarenko HDinsight: spark. advanced in memory big-data analytics wi...
Vitalii Bondarenko HDinsight: spark. advanced in memory big-data analytics wi...Vitalii Bondarenko HDinsight: spark. advanced in memory big-data analytics wi...
Vitalii Bondarenko HDinsight: spark. advanced in memory big-data analytics wi...Аліна Шепшелей
 
SE2016 BigData Vitalii Bondarenko "HD insight spark. Advanced in-memory Big D...
SE2016 BigData Vitalii Bondarenko "HD insight spark. Advanced in-memory Big D...SE2016 BigData Vitalii Bondarenko "HD insight spark. Advanced in-memory Big D...
SE2016 BigData Vitalii Bondarenko "HD insight spark. Advanced in-memory Big D...Inhacking
 

Similar to Dynamic C++ Silicon Valley Code Camp 2012 (20)

Refactoring to Macros with Clojure
Refactoring to Macros with ClojureRefactoring to Macros with Clojure
Refactoring to Macros with Clojure
 
Cpp tutorial
Cpp tutorialCpp tutorial
Cpp tutorial
 
2 BytesC++ course_2014_c3_ function basics&parameters and overloading
2 BytesC++ course_2014_c3_ function basics&parameters and overloading2 BytesC++ course_2014_c3_ function basics&parameters and overloading
2 BytesC++ course_2014_c3_ function basics&parameters and overloading
 
Example R usage for oracle DBA UKOUG 2013
Example R usage for oracle DBA UKOUG 2013Example R usage for oracle DBA UKOUG 2013
Example R usage for oracle DBA UKOUG 2013
 
CppTutorial.ppt
CppTutorial.pptCppTutorial.ppt
CppTutorial.ppt
 
CouchDB Mobile - From Couch to 5K in 1 Hour
CouchDB Mobile - From Couch to 5K in 1 HourCouchDB Mobile - From Couch to 5K in 1 Hour
CouchDB Mobile - From Couch to 5K in 1 Hour
 
ComputeFest 2012: Intro To R for Physical Sciences
ComputeFest 2012: Intro To R for Physical SciencesComputeFest 2012: Intro To R for Physical Sciences
ComputeFest 2012: Intro To R for Physical Sciences
 
Paradigmas de programação funcional + objetos no liquidificador com scala
Paradigmas de programação funcional + objetos no liquidificador com scalaParadigmas de programação funcional + objetos no liquidificador com scala
Paradigmas de programação funcional + objetos no liquidificador com scala
 
RR & Docker @ MuensteR Meetup (Sep 2017)
RR & Docker @ MuensteR Meetup (Sep 2017)RR & Docker @ MuensteR Meetup (Sep 2017)
RR & Docker @ MuensteR Meetup (Sep 2017)
 
PostgreSQL Open SV 2018
PostgreSQL Open SV 2018PostgreSQL Open SV 2018
PostgreSQL Open SV 2018
 
Nosql hands on handout 04
Nosql hands on handout 04Nosql hands on handout 04
Nosql hands on handout 04
 
A New Chapter of Data Processing with CDK
A New Chapter of Data Processing with CDKA New Chapter of Data Processing with CDK
A New Chapter of Data Processing with CDK
 
C++ tutorial
C++ tutorialC++ tutorial
C++ tutorial
 
Getting started with ES6
Getting started with ES6Getting started with ES6
Getting started with ES6
 
Java and xml
Java and xmlJava and xml
Java and xml
 
Full-Stack JavaScript with Node.js
Full-Stack JavaScript with Node.jsFull-Stack JavaScript with Node.js
Full-Stack JavaScript with Node.js
 
Next Generation Indexes For Big Data Engineering (ODSC East 2018)
Next Generation Indexes For Big Data Engineering (ODSC East 2018)Next Generation Indexes For Big Data Engineering (ODSC East 2018)
Next Generation Indexes For Big Data Engineering (ODSC East 2018)
 
NVIDIA HPC ソフトウエア斜め読み
NVIDIA HPC ソフトウエア斜め読みNVIDIA HPC ソフトウエア斜め読み
NVIDIA HPC ソフトウエア斜め読み
 
Vitalii Bondarenko HDinsight: spark. advanced in memory big-data analytics wi...
Vitalii Bondarenko HDinsight: spark. advanced in memory big-data analytics wi...Vitalii Bondarenko HDinsight: spark. advanced in memory big-data analytics wi...
Vitalii Bondarenko HDinsight: spark. advanced in memory big-data analytics wi...
 
SE2016 BigData Vitalii Bondarenko "HD insight spark. Advanced in-memory Big D...
SE2016 BigData Vitalii Bondarenko "HD insight spark. Advanced in-memory Big D...SE2016 BigData Vitalii Bondarenko "HD insight spark. Advanced in-memory Big D...
SE2016 BigData Vitalii Bondarenko "HD insight spark. Advanced in-memory Big D...
 

Recently uploaded

Ransomware_Q4_2023. The report. [EN].pdf
Ransomware_Q4_2023. The report. [EN].pdfRansomware_Q4_2023. The report. [EN].pdf
Ransomware_Q4_2023. The report. [EN].pdfOverkill Security
 
Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...
Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...
Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...apidays
 
presentation ICT roal in 21st century education
presentation ICT roal in 21st century educationpresentation ICT roal in 21st century education
presentation ICT roal in 21st century educationjfdjdjcjdnsjd
 
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...apidays
 
TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
TrustArc Webinar - Unlock the Power of AI-Driven Data DiscoveryTrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
TrustArc Webinar - Unlock the Power of AI-Driven Data DiscoveryTrustArc
 
FWD Group - Insurer Innovation Award 2024
FWD Group - Insurer Innovation Award 2024FWD Group - Insurer Innovation Award 2024
FWD Group - Insurer Innovation Award 2024The Digital Insurer
 
ICT role in 21st century education and its challenges
ICT role in 21st century education and its challengesICT role in 21st century education and its challenges
ICT role in 21st century education and its challengesrafiqahmad00786416
 
Architecting Cloud Native Applications
Architecting Cloud Native ApplicationsArchitecting Cloud Native Applications
Architecting Cloud Native ApplicationsWSO2
 
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FMESafe Software
 
Boost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdfBoost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdfsudhanshuwaghmare1
 
MS Copilot expands with MS Graph connectors
MS Copilot expands with MS Graph connectorsMS Copilot expands with MS Graph connectors
MS Copilot expands with MS Graph connectorsNanddeep Nachan
 
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...DianaGray10
 
EMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWER
EMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWEREMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWER
EMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWERMadyBayot
 
Apidays New York 2024 - Passkeys: Developing APIs to enable passwordless auth...
Apidays New York 2024 - Passkeys: Developing APIs to enable passwordless auth...Apidays New York 2024 - Passkeys: Developing APIs to enable passwordless auth...
Apidays New York 2024 - Passkeys: Developing APIs to enable passwordless auth...apidays
 
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerThousandEyes
 
Polkadot JAM Slides - Token2049 - By Dr. Gavin Wood
Polkadot JAM Slides - Token2049 - By Dr. Gavin WoodPolkadot JAM Slides - Token2049 - By Dr. Gavin Wood
Polkadot JAM Slides - Token2049 - By Dr. Gavin WoodJuan lago vázquez
 
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost SavingRepurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost SavingEdi Saputra
 
"I see eyes in my soup": How Delivery Hero implemented the safety system for ...
"I see eyes in my soup": How Delivery Hero implemented the safety system for ..."I see eyes in my soup": How Delivery Hero implemented the safety system for ...
"I see eyes in my soup": How Delivery Hero implemented the safety system for ...Zilliz
 
Why Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire businessWhy Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire businesspanagenda
 
DBX First Quarter 2024 Investor Presentation
DBX First Quarter 2024 Investor PresentationDBX First Quarter 2024 Investor Presentation
DBX First Quarter 2024 Investor PresentationDropbox
 

Recently uploaded (20)

Ransomware_Q4_2023. The report. [EN].pdf
Ransomware_Q4_2023. The report. [EN].pdfRansomware_Q4_2023. The report. [EN].pdf
Ransomware_Q4_2023. The report. [EN].pdf
 
Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...
Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...
Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...
 
presentation ICT roal in 21st century education
presentation ICT roal in 21st century educationpresentation ICT roal in 21st century education
presentation ICT roal in 21st century education
 
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
 
TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
TrustArc Webinar - Unlock the Power of AI-Driven Data DiscoveryTrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
 
FWD Group - Insurer Innovation Award 2024
FWD Group - Insurer Innovation Award 2024FWD Group - Insurer Innovation Award 2024
FWD Group - Insurer Innovation Award 2024
 
ICT role in 21st century education and its challenges
ICT role in 21st century education and its challengesICT role in 21st century education and its challenges
ICT role in 21st century education and its challenges
 
Architecting Cloud Native Applications
Architecting Cloud Native ApplicationsArchitecting Cloud Native Applications
Architecting Cloud Native Applications
 
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
 
Boost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdfBoost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdf
 
MS Copilot expands with MS Graph connectors
MS Copilot expands with MS Graph connectorsMS Copilot expands with MS Graph connectors
MS Copilot expands with MS Graph connectors
 
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
 
EMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWER
EMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWEREMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWER
EMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWER
 
Apidays New York 2024 - Passkeys: Developing APIs to enable passwordless auth...
Apidays New York 2024 - Passkeys: Developing APIs to enable passwordless auth...Apidays New York 2024 - Passkeys: Developing APIs to enable passwordless auth...
Apidays New York 2024 - Passkeys: Developing APIs to enable passwordless auth...
 
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected Worker
 
Polkadot JAM Slides - Token2049 - By Dr. Gavin Wood
Polkadot JAM Slides - Token2049 - By Dr. Gavin WoodPolkadot JAM Slides - Token2049 - By Dr. Gavin Wood
Polkadot JAM Slides - Token2049 - By Dr. Gavin Wood
 
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost SavingRepurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
 
"I see eyes in my soup": How Delivery Hero implemented the safety system for ...
"I see eyes in my soup": How Delivery Hero implemented the safety system for ..."I see eyes in my soup": How Delivery Hero implemented the safety system for ...
"I see eyes in my soup": How Delivery Hero implemented the safety system for ...
 
Why Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire businessWhy Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire business
 
DBX First Quarter 2024 Investor Presentation
DBX First Quarter 2024 Investor PresentationDBX First Quarter 2024 Investor Presentation
DBX First Quarter 2024 Investor Presentation
 

Dynamic C++ Silicon Valley Code Camp 2012

  • 1. Dynamic C++ POCOC++ PORTABLE COMPONENTS alex@pocoproject.org Sunday, October 7, 12
  • 2. Content > The Problem > The Solution > The Anatomy of the Solution > The Heart and Soul of the Solution > Let’s Dance - code example > Other solutions > Performance and comparisons > Conclusion Sunday, October 7, 12
  • 3. "Without a good library,most interesting tasks are hard to do in C++; but given a good library,almost any task can be made easy." Bjarne Stroustrup (designer and original implementor of C++) Sunday, October 7, 12
  • 4. A Brief History of Data Access Sunday, October 7, 12
  • 5. Data Formats > often in proprietary binary format > transform into character strings of desired format > server-side needs an equivalent of HTML rendering engine Sunday, October 7, 12
  • 6. So,how do we do this? > generate the desired format in the database :- > use dynamic language > mix HTML with server-side code and compile on the fly (shudder) > browser plugin (double-shudder) > or ... use static language on the server-side and AJA(X|J) in the browser? Sunday, October 7, 12
  • 7. SELECT * FROM Simpsons > discover column count The Problem > discover column data types > bind returned data to variables Sunday, October 7, 12
  • 8. SQLRETURN rc; SQLHENV henv = SQL_NULL_HENV; SQLHDBC hdbc = SQL_NULL_HDBC; SQLHSTMT hstmt = SQL_NULL_HSTMT; rc = SQLAllocHandle(SQL_HANDLE_ENV, SQL_NULL_HANDLE, &henv); odbc_check_env (rc, henv); rc = SQLSetEnvAttr(henv, SQL_ATTR_ODBC_VERSION, (SQLPOINTER) SQL_OV_ODBC3, 0); odbc_check_env (rc, henv); rc = SQLAllocHandle(SQL_HANDLE_DBC, henv, &hdbc); odbc_check_dbc (rc, hdbc); SQLCHAR connectOutput[1024] = {0}; SQLSMALLINT result; rc = SQLDriverConnect(hdbc,NULL,(SQLCHAR*)dbConnString.c_str(),(SQLSMALLINT)SQL_NTS,connectOutput,sizeof(connectOutput),&result,SQL_DRIVER_NOPROMPT); odbc_check_dbc (rc, hdbc); sql = "SELECT * FROM Simpsons"; SQLCHAR* pStr = (SQLCHAR*) sql.c_str(); rc = SQLPrepare(hstmt, pStr, (SQLINTEGER) sql.length()); odbc_check_stmt (rc, hstmt); char name[50] = { 0 }; SQLLEN lengths[3] = { 0 }; int age = 0; float weight = 0.0f; std::memset(&sixth, 0, sizeof(sixth)); rc = SQLBindCol(hstmt, (SQLUSMALLINT) 1, SQL_C_CHAR, (SQLPOINTER) chr, (SQLINTEGER) sizeof(chr[0]), &lengths[0]); odbc_check_stmt (rc, hstmt); rc = SQLBindCol(hstmt, (SQLUSMALLINT) 2, SQL_C_INTEGER, (SQLPOINTER) &age, (SQLINTEGER) sizeof(age), &lengths[1]); odbc_check_stmt (rc, hstmt); rc = SQLBindCol(hstmt, (SQLUSMALLINT) 3, SQL_C_BINARY, (SQLPOINTER) &weight, (SQLINTEGER) sizeof(weight), &lengths[2]); odbc_check_stmt (rc, hstmt); printf(“Name: %s, Age: %d, Weight: %f”, name, age, weight); ! ! “solution” © mark du toit Sunday, October 7, 12
  • 9. using namespace Poco::Data::SQLite; int main() { Session session("SQLite", "simpsons.db"); std::cout << RecordSet(session, "SELECT * FROM Simpsons"); return 0; } The Solution © mark du toit Sunday, October 7, 12
  • 10. Statement stmt = (session << "SELECT * FROM Simpsons", now); RecordSet rs(stmt); ostream& operator << (ostream &os, const RecordSet& rs) { return rs.copy(os); } The Anatomy of the Solution (step - by - step) Sunday, October 7, 12
  • 11. The Anatomy of the Solution (under the hood) using namespace std; ostream& RecordSet::copy(ostream& os, size_t offset = 0, size_t length = END) { RowFormatter& rf = (*_pBegin)->getFormatter(); os << rf.prefix(); copyNames(os); copyValues(os, offset, length); os << rf.postfix(); return os; } ostream& RecordSet::copyValues(ostream& os, size_t offset, size_t length) { RowIterator begin = *_pBegin + offset; RowIterator end = (RowIterator::END != length) ? it + length : *_pEnd; std::copy(begin, end, std::ostream_iterator<Row>(os)); return os; } Sunday, October 7, 12
  • 12. Row& RowIterator::operator * () { if (END == _position) throw InvalidAccessException("End of iterator reached."); return _pRecordSet->row(_position); } ostream& operator << (ostream &os, const Row& row) { os << row.valuesToString(); return os; } const string& Row::valuesToString() const { return _pFormatter->formatValues(values(), _valueStr); } The Anatomy of the Solution,contd. (STL - compliance) Sunday, October 7, 12
  • 13. class Row { public: // ... template <typename T> void set(size_t pos, const T& val) { try { _values.at(pos) = val; } catch (out_of_range&) { throw RangeException("Invalid column."); } } // ... private: vector<Poco::Dynamic::Var> _values; }; The Heart of the Solution (Row::set) Sunday, October 7, 12
  • 14. namespace Poco { namespace Dynamic { class Var { public: // ... template <typename T> Var(const T& val): _pHolder(new VarHolderImpl<T>(val)) { } // ... private: VarHolder* _pHolder; }; } } The Soul of the Machine (Poco::Dynamic::Var) * Design based on boost::any Sunday, October 7, 12
  • 15. So,where was boost::any found lacking ? It’s a great idea with limited applicability - dynamic on receiving,but static on the giving end. using boost::any; using boost::any_cast; typedef std::list<any> many; int ival = 42; std::string sval = “fourty two”; values.push_back(ival); values.push_back(sval); std::string sival = values[0]; // oops!, compile error sival = any_cast<std::string>(values[0]); // still oops!, throw Sunday, October 7, 12
  • 16. Var in Practical Use std::string s1("string"); Poco::Int8 s2(23); std::vector<Var> s16; s16.push_back(s1); s16.push_back(s2); Var a1(s16); std::string res = a1.convert<std::string>(); // ["string", 23] DynamicStruct aStruct; aStruct["First Name"] = "Junior"; aStruct["Last Name"] = "POCO"; aStruct["Age"] = 1; Var a1(aStruct); std::string res = a1.convert<std::string>(); // { "Age”: 1, "First Name": "Junior", "Last Name" : "POCO" } std::string str("42"); Var v1 = str; // "42" double d = v1; // 42.0 Var v2 = d + 1.0; // 43.0 float f = v2 + 1; // 44.0 Sunday, October 7, 12
  • 17. What Else is in the Var Box > Dynamic array, pair and struct (map) support (Poco::Dynamic::Pair/Struct) > JSON (de)serialization of the above > Empty value support (very handy with null DB fields) > Strict conversion checks Sunday, October 7, 12
  • 18. namespace Poco { namespace Dynamic { class VarHolder { public: virtual ~VarHolder(); virtual void convert(int& val) const; // ... protected: VarHolder(); // ... }; template <typename T> // for end-user extensions class VarHolderImpl: public VarHolder { //... }; template <> // native and frequently used types specializations provided by POCO class VarHolderImpl<int>: public VarHolder { //... }; //... }} The Soul of the Machine (Poco::Dynamic::VarHolder) Sunday, October 7, 12
  • 20. Let’s Dance class DataRequestHandler: public HTTPRequestHandler { public: void handleRequest(HTTPServerRequest& request, HTTPServerResponse& response) { response.setChunkedTransferEncoding(true); response.setContentType("text/xml"); ostream& ostr = response.send(); Session sess("SQLite", "sample.db"); ostr << RecordSet(sess, "SELECT * FROM Simpsons", new XMLFormatter); } }; Sunday, October 7, 12
  • 21. A Real World Example Sunday, October 7, 12
  • 22. Is it REALLY Dynamic? Of course not. Dig deep enough and there is no such thing as dynamic. Type handlers are templates,hence generated by compiler and statically checked for type. Sunday, October 7, 12
  • 23. And there’s a price to pay ... Binary sizes: ============ Linux ----- 5160 AnySize.o 23668 DynamicAnySizeExtract.o 25152 DynamicAnySizeConvert.o 9600 lexical_cast_size.o Windows ------- 26,924 AnySize.obj 96,028 DynamicAnySizeExtract.obj 103,943 DynamicAnySizeConvert.obj 84,217 lexical_cast_size.obj Lines of code: ============= Any 145 DynamicAny* 3,588 lexical_cast 971 Sunday, October 7, 12
  • 24. struct Person { std::string name; std::string address; int age; }; But what if I need performance? There is,of course,a lean and elegant static workaround. In fact,several of them ... Sunday, October 7, 12
  • 25. namespace Poco { namespace Data { template <> class TypeHandler<Person> { public: static std::size_t size() { return 3; } static void bind(size_t pos, const Person& person, AbstractBinder* pBinder, Direction dir) { TypeHandler<std::string>::bind(pos++, person.name, pBinder, dir); TypeHandler<std::string>::bind(pos++, person.address, pBinder, dir); TypeHandler<int>::bind(pos++, person.age, pBinder, dir); } static void extract(size_t pos, Person& person, const Person& deflt, AbstractExtractor* pE) { TypeHandler<std::string>::extract(pos++, person.name, deflt.name, pExtr); TypeHandler<std::string>::extract(pos++, person.address, deflt.address, pExtr); TypeHandler<int>::extract(pos++, person.age, deflt.age, pExtr); } }; } } Scaffolding - wrap Person into a TypeHandler Sunday, October 7, 12
  • 26. Person person = { "Bart Simpson", "Springfield", 12 }; session << "INSERT INTO Person VALUES(?, ?, ?)", use(person); std::vector<Person> people; session << "SELECT Name, Address, Age FROM Person",into(people), now; And Life is Good Again std::string name, address; int age; session << "INSERT INTO Person VALUES(?, ?, ?)", use(name), use(address), use(age); Sunday, October 7, 12
  • 27. using namespace std; using namespace Poco; typedef Tuple<string, string, int> Person; typedef vector<Person> People; People people; people.push_back(Person("Bart Simpson", "Springfield", 12)); people.push_back(Person("Lisa Simpson", "Springfield", 10)); session << "INSERT INTO Person VALUES(?, ?, ?)", use(people), now; people.clear(); session << "SELECT Name, Address, Age FROM Person", into(people), now; But wait,there’s more! Sunday, October 7, 12
  • 28. What else is out there ? > void* > C union > MS COM Variant > boost::variant > boost::lexical_cast > boost::type_erasure > folly::dynamic Sunday, October 7, 12
  • 30. ACCU Overload Journal Articles http://accu.org/index.php/journals/1511 http://accu.org/index.php/journals/1502 Sunday, October 7, 12
  • 31. Last but not Least POCO > large, comprehensive, well-designed framework > designed for practical everyday use, with end-user in mind > makes C++ programming fun > 100% standard C++ > not reinventing the wheel (except when necessary ;-) http://poco.svn.sourceforge.net/viewvc/poco/poco/trunk https://poco.svn.sourceforge.net/svnroot/poco/poco/trunk http://pocoproject.org Sunday, October 7, 12
  • 32. got POCO?C++ PORTABLE COMPONENTS http://pocoproject.org alex@pocoproject.org Sunday, October 7, 12