This document provides information about files and file handling in Django. It discusses Django's FileField and ImageField model fields, how files are stored using different storage backends like FileSystemStorage and S3BotoStorage, working with files in forms and templates, static file management, and asset pipelines. It also lists several Django ticket issues related to files.
My Django Under the Hood 2015 talk, which includes a whistlestop tour of Django File with HTTP, Form & ORM integration, Storage backends, contrib.staticfiles, Form.Media and asset pipelines, including some thoughts on how to integrate arbitrary asset pipelines with Django.
(The export from Keynote is horrible. Previous exports I've done weren't so horrible; I don't know if this is a newer version, or my getting the options wrong. If I figure it out, I'll fix it.)
Delegated Configuration with Multiple Hiera Databases - PuppetConf 2014Puppet
This document discusses using Hiera to provide delegated configuration through multiple data sources. It begins with an introduction to Hiera and its uses. It then discusses using multiple backends like YAML and PostgreSQL to store hierarchical data. The document proposes a designed solution to delegate access to certain Hiera keys by filtering and importing data from external sources into a separate database. This database would act as a secondary Hiera backend. The solution is intended to allow certain users to manage configuration parameters for a subset of servers in a secure manner.
r packagesdata analytics study material;
learn data analytics online;
data analytics courses;
courses for data analysis;
courses for data analytics;
online data analysis courses;
courses on data analysis;
data analytics classes;
data analysis training courses online;
courses in data analysis;
data analysis courses online;
data analytics training;
courses for data analyst;
data analysis online course;
data analysis certification;
data analysis courses;
data analysis classes;
online course data analysis;
learn data analysis online;
data analysis training;
python for data analysis course;
learn data analytics;
study data analytics;
how to learn data analytics;
data analysis course free;
statistical methods and data analysis;
big data analytics;
data analysis companies;
python data analysis course;
tools that can be used to analyse data;
data analysis consulting;
basic data analytics;
data analysis programs;
examples of data analysis tools;
big data analysis tools;
data analytics tools and techniques;
statistics for data analytics;
data analytics tools;
data analytics and big data;
data analytics big data;
data analysis software;
data analytics with excel;
website data analysis;
data analytics companies;
data analysis qualifications;
tools for data analytics;
data analysis tools;
qualitative data analysis software;
free data analytics;
data analysis website;
tools for analyzing data;
data analytics software;
free data analysis software;
tools for analysing data;
data mining book;
learn data analysis;
about data analytics;
statistical data analysis software;
it data analytics;
data analytics tutorial for beginners;
unstructured data analytics;
data analytics using excel;
dissertation data analysis;
sample of data analysis;
data analysis online;
data analytics;
tools of data analysis;
analytical tools for data analysis;
statistical tools to analyse data;
data analysis help;
data analysis education;
statistical technique for data analysis;
tools for data analysis;
how to learn data analysis;
data analytics tutorial;
excel data analytics;
data mining course;
data analysis software free;
big data and data analytics;
statistical analysis software;
tools to analyse data;
online data analysis;
data mining software;
data analytics statistics;
how to do data analytics;
statistical data analysis tools;
data analyst tools;
business data analysis;
tools and techniques of data analysis;
education data analysis;
advanced data analytics;
study data analysis;
spreadsheet data analysis;
learn data analysis in excel;
software for data analysis;
shared data warehouse;
what are data analysis tools;
data analytics and statistics;
data analyse;
analysis courses;
data analysis tools for research;
research data analysis tools;
big data analysis;
data mining programs;
applications of data analytics;
data analysis tools and techniques;
data analysis business;
Hiera is a tool for managing configuration data in Puppet. It allows storing data in hierarchical YAML files and retrieving values based on node facts. This avoids duplicating data across manifests and modules. The document discusses using Hiera to look up data based on hostname, environment, and custom facts. It also covers debugging Hiera lookups and using encrypted YAML to securely store sensitive data.
Big Data Step-by-Step: Using R & Hadoop (with RHadoop's rmr package)Jeffrey Breen
The document describes a Big Data workshop held on March 10, 2012 at the Microsoft New England Research & Development Center in Cambridge, MA. The workshop focused on using R and Hadoop, with an emphasis on RHadoop's rmr package. The document provides an introduction to using R with Hadoop and discusses several R packages for working with Hadoop, including RHIPE, rmr, rhdfs, and rhbase. Code examples are presented demonstrating how to calculate average departure delays by airline and month from an airline on-time performance dataset using different approaches, including Hadoop streaming, hive, RHIPE and rmr.
This document discusses building distributed search applications using Apache Solr. It provides an agenda that covers topics such as Solr architecture, schema configuration, indexing data, querying, SolrCloud, and performance factors. It also references a demo app that will be used for hands-on examples during the presentation.
Puppet Camp Phoenix 2015: Managing Files via Puppet: Let Me Count The Ways (B...Puppet
The document discusses various ways to manage files and lines within files using Puppet, including using the file, concat, augeas, file_line, inifile, datacat, and template resources and functions. It provides examples of managing entire files, specific lines, using static content or templates, and leveraging other modules to manage files and configurations.
My Django Under the Hood 2015 talk, which includes a whistlestop tour of Django File with HTTP, Form & ORM integration, Storage backends, contrib.staticfiles, Form.Media and asset pipelines, including some thoughts on how to integrate arbitrary asset pipelines with Django.
(The export from Keynote is horrible. Previous exports I've done weren't so horrible; I don't know if this is a newer version, or my getting the options wrong. If I figure it out, I'll fix it.)
Delegated Configuration with Multiple Hiera Databases - PuppetConf 2014Puppet
This document discusses using Hiera to provide delegated configuration through multiple data sources. It begins with an introduction to Hiera and its uses. It then discusses using multiple backends like YAML and PostgreSQL to store hierarchical data. The document proposes a designed solution to delegate access to certain Hiera keys by filtering and importing data from external sources into a separate database. This database would act as a secondary Hiera backend. The solution is intended to allow certain users to manage configuration parameters for a subset of servers in a secure manner.
r packagesdata analytics study material;
learn data analytics online;
data analytics courses;
courses for data analysis;
courses for data analytics;
online data analysis courses;
courses on data analysis;
data analytics classes;
data analysis training courses online;
courses in data analysis;
data analysis courses online;
data analytics training;
courses for data analyst;
data analysis online course;
data analysis certification;
data analysis courses;
data analysis classes;
online course data analysis;
learn data analysis online;
data analysis training;
python for data analysis course;
learn data analytics;
study data analytics;
how to learn data analytics;
data analysis course free;
statistical methods and data analysis;
big data analytics;
data analysis companies;
python data analysis course;
tools that can be used to analyse data;
data analysis consulting;
basic data analytics;
data analysis programs;
examples of data analysis tools;
big data analysis tools;
data analytics tools and techniques;
statistics for data analytics;
data analytics tools;
data analytics and big data;
data analytics big data;
data analysis software;
data analytics with excel;
website data analysis;
data analytics companies;
data analysis qualifications;
tools for data analytics;
data analysis tools;
qualitative data analysis software;
free data analytics;
data analysis website;
tools for analyzing data;
data analytics software;
free data analysis software;
tools for analysing data;
data mining book;
learn data analysis;
about data analytics;
statistical data analysis software;
it data analytics;
data analytics tutorial for beginners;
unstructured data analytics;
data analytics using excel;
dissertation data analysis;
sample of data analysis;
data analysis online;
data analytics;
tools of data analysis;
analytical tools for data analysis;
statistical tools to analyse data;
data analysis help;
data analysis education;
statistical technique for data analysis;
tools for data analysis;
how to learn data analysis;
data analytics tutorial;
excel data analytics;
data mining course;
data analysis software free;
big data and data analytics;
statistical analysis software;
tools to analyse data;
online data analysis;
data mining software;
data analytics statistics;
how to do data analytics;
statistical data analysis tools;
data analyst tools;
business data analysis;
tools and techniques of data analysis;
education data analysis;
advanced data analytics;
study data analysis;
spreadsheet data analysis;
learn data analysis in excel;
software for data analysis;
shared data warehouse;
what are data analysis tools;
data analytics and statistics;
data analyse;
analysis courses;
data analysis tools for research;
research data analysis tools;
big data analysis;
data mining programs;
applications of data analytics;
data analysis tools and techniques;
data analysis business;
Hiera is a tool for managing configuration data in Puppet. It allows storing data in hierarchical YAML files and retrieving values based on node facts. This avoids duplicating data across manifests and modules. The document discusses using Hiera to look up data based on hostname, environment, and custom facts. It also covers debugging Hiera lookups and using encrypted YAML to securely store sensitive data.
Big Data Step-by-Step: Using R & Hadoop (with RHadoop's rmr package)Jeffrey Breen
The document describes a Big Data workshop held on March 10, 2012 at the Microsoft New England Research & Development Center in Cambridge, MA. The workshop focused on using R and Hadoop, with an emphasis on RHadoop's rmr package. The document provides an introduction to using R with Hadoop and discusses several R packages for working with Hadoop, including RHIPE, rmr, rhdfs, and rhbase. Code examples are presented demonstrating how to calculate average departure delays by airline and month from an airline on-time performance dataset using different approaches, including Hadoop streaming, hive, RHIPE and rmr.
This document discusses building distributed search applications using Apache Solr. It provides an agenda that covers topics such as Solr architecture, schema configuration, indexing data, querying, SolrCloud, and performance factors. It also references a demo app that will be used for hands-on examples during the presentation.
Puppet Camp Phoenix 2015: Managing Files via Puppet: Let Me Count The Ways (B...Puppet
The document discusses various ways to manage files and lines within files using Puppet, including using the file, concat, augeas, file_line, inifile, datacat, and template resources and functions. It provides examples of managing entire files, specific lines, using static content or templates, and leveraging other modules to manage files and configurations.
Writing and Sharing Great Modules with the Puppet ForgePuppet
Ryan Coleman's talk on "Writing and Sharing Great Modules with the Puppet Forge" at Puppet Camp Baltimore, Atlanta, and Chicago 2013. Learn about upcoming Puppet Camps at http://puppetlabs.com/community/puppet-camp/
This document provides an overview of customizing themes in DSpace 4.2 XMLUI. It discusses creating new themes, customizing themes using CSS (colors, fonts, images, layout), controlling data presentation with XSL (transforming XML, XSLT, XPath), applying themes in the XMLUI configuration file, and interactive interfaces using JavaScript. It provides examples and ideas for easy, intermediate, and challenging customizations such as fonts, colors, images, removing/adding elements, ordering elements logically, and interactive animations.
This document summarizes a presentation about rapid prototyping with Solr. It discusses getting documents indexed into Solr quickly, adjusting Solr's schema to better match needs, and showcasing data in a flexible search UI. It outlines how to leverage faceting, highlighting, spellchecking and debugging in rapid prototyping. Finally, it discusses next steps in developing a search application and taking it to production.
This document discusses a presentation on advanced uses of generators in Python. It covers context managers, which allow entry and exit actions for code blocks using the 'with' statement. Generators can be used to implement context managers via the yield keyword and decorator contextmanager. This transforms generator functions into objects that support the required __enter__ and __exit__ methods to monitor code block execution. The presentation aims to expand understanding of generators beyond iteration by exploring this technique for simplifying resource management tasks like file handling through context managers.
The configuration management system in Drupal 8 seems like a great idea, but what is it? In this session I hope to show what configuration management is, why it is needed and how it will make all of our lives as Drupal site builders better.
This document provides an overview and instructions for various content transmission features in DSpace 4.2, including harvesting and disseminating content using OAI/PMH, reading content with REST, exporting and importing content using submission information packages (SIPs) and dissemination information packages (DIPs), depositing content using SWORD, and importing content using the simple archive format (SAF). It discusses configuring the OAI content source, metadata crosswalks, and the REST API. It also provides examples of using the DSpace packager for submissions and disseminations, making deposits via cURL with SWORD, and batch importing content from CSV and MARC XML files using the SAF format.
The document describes a presentation about rapidly prototyping with Solr. It will demonstrate ingesting documents into Solr, adjusting Solr's schema, and showcasing data in a flexible search UI. The presentation will cover faceting, highlighting, spellchecking, and debugging. Time will also be spent outlining next steps to develop and take the search application to production.
Tutorial on developing a Solr search component pluginsearchbox-com
In this set of slides we give a step by step tutorial on how to develop a fully functional solr search component plugin. Additionally we provide links to full source code which can be used as a template to rapidly start creating your own search components.
This document summarizes the key options and methods for managing files using Puppet, including:
1. The file resource type which can specify a file's source location or content template.
2. The concat module which concatenates file fragments in a defined order.
3. The file_line resource which manages single lines in files.
4. The inifile module for managing ini-style configuration files.
5. The Augeas tool for advanced parsing and editing of complex configuration files.
code4lib 2011 preconference: What's New in Solr (since 1.4.1)Erik Hatcher
code4lib 2011 preconference, presented by Erik Hatcher of Lucid Imagination.
Abstract: The library world is fired up about Solr. Practically every next-gen catalog is using it (via Blacklight, VuFind, or other technologies). Solr has continued improving in some dramatic ways, including geospatial support, field collapsing/grouping, extended dismax query parsing, pivot/grid/matrix/tree faceting, autosuggest, and more. This session will cover all of these new features, showcasing live examples of them all, including anything new that is implemented prior to the conference.
Apache Solr is an open-source enterprise search platform that provides fast, scalable, and reliable full-text search functionality. It powers the search capabilities of many large websites and applications. Some key features of Solr include fast indexing and search, faceted search, autocomplete, geospatial search, and integration with various databases and applications.
This document provides an overview of Apache Solr, an open source search platform based on Lucene. It discusses how Solr works, including indexing documents, defining schemas, querying the index via HTTP requests, and returning results in XML or JSON format. The document also provides examples of queries, updating the index, and customizing the analyzer for Thai language support.
Configuration Management in Drupal 8: A preview (DrupalDays Milano 2014)Nuvole
This document provides an overview of configuration management in Drupal 8. It discusses how configuration is now stored in files rather than the database for easier transport between environments. It outlines the process for modifying configuration on a development site, exporting changes, and importing them into a production site. It also notes some limitations of the current configuration management system and areas still under development before Drupal 8 is released.
1) The document discusses how WordPress parses URLs and generates SQL queries to retrieve content from the database. It explains how URLs are rewritten and query variables are extracted and used to build SQL statements.
2) It provides examples of different types of queries for posts, categories, tags, and custom post types. It also describes how WordPress uses JOIN operations to retrieve taxonomy terms and relationships.
3) The document outlines how WordPress selects template files based on conditional tags and discusses some ways to customize and modify the querying and template selection process.
Webinar - Windows Application Management with PuppetOlinData
This webinar will help you to understand how to install Windows application and services, We will also look into how to manage windows services related to the application.
This document discusses how WordPress handles URL requests and database queries. It explains how URLs are parsed into query variables, how those variables are used to generate SQL queries against the database, and how the results are then used to determine which templates to load. It provides examples of how to modify the default behavior using hooks, custom post types, and other techniques. The goal is to help developers better understand and optimize the default WordPress querying process.
Lucene powers the search capabilities of practically all library discovery platforms, by way of Solr, etc. The Lucene project evolves rapidly, and it's a full-time job to keep up with the ever improving features and scalability. This talk will distill and showcase the most relevant(!) advancements to date.
This document summarizes a Solr Recipes Workshop presented by Erik Hatcher of Lucid Imagination. It introduces Lucene and Solr, describes how to index different content sources into Solr including CSV, XML, rich documents, and databases, and provides an overview of using the DataImportHandler to index from a relational database.
Data Replication Options in AWS (ARC302) | AWS re:Invent 2013Amazon Web Services
One of the most critical roles of an IT department is to protect and serve its corporate data. As a result, IT departments spend tremendous amounts of resources developing, designing, testing, and optimizing data recovery and replication options in order to improve data availability and service response time. This session outlines replication challenges, key design patterns, and methods commonly used in today’s IT environment. Furthermore, the session provides different data replication solutions available in the AWS cloud. Finally, the session outlines several key factors to be considered when implementing data replication architectures in the AWS cloud.
This document provides an overview and introduction to the Solr search platform. It describes how Solr can be used to index and search content, integrate with other systems, and handle common search issues. The presentation also discusses Lucene, the search library that powers Solr, and how content from various sources like databases, files, and rich documents can be indexed.
Writing and Sharing Great Modules with the Puppet ForgePuppet
Ryan Coleman's talk on "Writing and Sharing Great Modules with the Puppet Forge" at Puppet Camp Baltimore, Atlanta, and Chicago 2013. Learn about upcoming Puppet Camps at http://puppetlabs.com/community/puppet-camp/
This document provides an overview of customizing themes in DSpace 4.2 XMLUI. It discusses creating new themes, customizing themes using CSS (colors, fonts, images, layout), controlling data presentation with XSL (transforming XML, XSLT, XPath), applying themes in the XMLUI configuration file, and interactive interfaces using JavaScript. It provides examples and ideas for easy, intermediate, and challenging customizations such as fonts, colors, images, removing/adding elements, ordering elements logically, and interactive animations.
This document summarizes a presentation about rapid prototyping with Solr. It discusses getting documents indexed into Solr quickly, adjusting Solr's schema to better match needs, and showcasing data in a flexible search UI. It outlines how to leverage faceting, highlighting, spellchecking and debugging in rapid prototyping. Finally, it discusses next steps in developing a search application and taking it to production.
This document discusses a presentation on advanced uses of generators in Python. It covers context managers, which allow entry and exit actions for code blocks using the 'with' statement. Generators can be used to implement context managers via the yield keyword and decorator contextmanager. This transforms generator functions into objects that support the required __enter__ and __exit__ methods to monitor code block execution. The presentation aims to expand understanding of generators beyond iteration by exploring this technique for simplifying resource management tasks like file handling through context managers.
The configuration management system in Drupal 8 seems like a great idea, but what is it? In this session I hope to show what configuration management is, why it is needed and how it will make all of our lives as Drupal site builders better.
This document provides an overview and instructions for various content transmission features in DSpace 4.2, including harvesting and disseminating content using OAI/PMH, reading content with REST, exporting and importing content using submission information packages (SIPs) and dissemination information packages (DIPs), depositing content using SWORD, and importing content using the simple archive format (SAF). It discusses configuring the OAI content source, metadata crosswalks, and the REST API. It also provides examples of using the DSpace packager for submissions and disseminations, making deposits via cURL with SWORD, and batch importing content from CSV and MARC XML files using the SAF format.
The document describes a presentation about rapidly prototyping with Solr. It will demonstrate ingesting documents into Solr, adjusting Solr's schema, and showcasing data in a flexible search UI. The presentation will cover faceting, highlighting, spellchecking, and debugging. Time will also be spent outlining next steps to develop and take the search application to production.
Tutorial on developing a Solr search component pluginsearchbox-com
In this set of slides we give a step by step tutorial on how to develop a fully functional solr search component plugin. Additionally we provide links to full source code which can be used as a template to rapidly start creating your own search components.
This document summarizes the key options and methods for managing files using Puppet, including:
1. The file resource type which can specify a file's source location or content template.
2. The concat module which concatenates file fragments in a defined order.
3. The file_line resource which manages single lines in files.
4. The inifile module for managing ini-style configuration files.
5. The Augeas tool for advanced parsing and editing of complex configuration files.
code4lib 2011 preconference: What's New in Solr (since 1.4.1)Erik Hatcher
code4lib 2011 preconference, presented by Erik Hatcher of Lucid Imagination.
Abstract: The library world is fired up about Solr. Practically every next-gen catalog is using it (via Blacklight, VuFind, or other technologies). Solr has continued improving in some dramatic ways, including geospatial support, field collapsing/grouping, extended dismax query parsing, pivot/grid/matrix/tree faceting, autosuggest, and more. This session will cover all of these new features, showcasing live examples of them all, including anything new that is implemented prior to the conference.
Apache Solr is an open-source enterprise search platform that provides fast, scalable, and reliable full-text search functionality. It powers the search capabilities of many large websites and applications. Some key features of Solr include fast indexing and search, faceted search, autocomplete, geospatial search, and integration with various databases and applications.
This document provides an overview of Apache Solr, an open source search platform based on Lucene. It discusses how Solr works, including indexing documents, defining schemas, querying the index via HTTP requests, and returning results in XML or JSON format. The document also provides examples of queries, updating the index, and customizing the analyzer for Thai language support.
Configuration Management in Drupal 8: A preview (DrupalDays Milano 2014)Nuvole
This document provides an overview of configuration management in Drupal 8. It discusses how configuration is now stored in files rather than the database for easier transport between environments. It outlines the process for modifying configuration on a development site, exporting changes, and importing them into a production site. It also notes some limitations of the current configuration management system and areas still under development before Drupal 8 is released.
1) The document discusses how WordPress parses URLs and generates SQL queries to retrieve content from the database. It explains how URLs are rewritten and query variables are extracted and used to build SQL statements.
2) It provides examples of different types of queries for posts, categories, tags, and custom post types. It also describes how WordPress uses JOIN operations to retrieve taxonomy terms and relationships.
3) The document outlines how WordPress selects template files based on conditional tags and discusses some ways to customize and modify the querying and template selection process.
Webinar - Windows Application Management with PuppetOlinData
This webinar will help you to understand how to install Windows application and services, We will also look into how to manage windows services related to the application.
This document discusses how WordPress handles URL requests and database queries. It explains how URLs are parsed into query variables, how those variables are used to generate SQL queries against the database, and how the results are then used to determine which templates to load. It provides examples of how to modify the default behavior using hooks, custom post types, and other techniques. The goal is to help developers better understand and optimize the default WordPress querying process.
Lucene powers the search capabilities of practically all library discovery platforms, by way of Solr, etc. The Lucene project evolves rapidly, and it's a full-time job to keep up with the ever improving features and scalability. This talk will distill and showcase the most relevant(!) advancements to date.
This document summarizes a Solr Recipes Workshop presented by Erik Hatcher of Lucid Imagination. It introduces Lucene and Solr, describes how to index different content sources into Solr including CSV, XML, rich documents, and databases, and provides an overview of using the DataImportHandler to index from a relational database.
Data Replication Options in AWS (ARC302) | AWS re:Invent 2013Amazon Web Services
One of the most critical roles of an IT department is to protect and serve its corporate data. As a result, IT departments spend tremendous amounts of resources developing, designing, testing, and optimizing data recovery and replication options in order to improve data availability and service response time. This session outlines replication challenges, key design patterns, and methods commonly used in today’s IT environment. Furthermore, the session provides different data replication solutions available in the AWS cloud. Finally, the session outlines several key factors to be considered when implementing data replication architectures in the AWS cloud.
This document provides an overview and introduction to the Solr search platform. It describes how Solr can be used to index and search content, integrate with other systems, and handle common search issues. The presentation also discusses Lucene, the search library that powers Solr, and how content from various sources like databases, files, and rich documents can be indexed.
This document discusses using document databases like CouchDB with TYPO3 Flow. It provides an overview of persistence basics in Flow and Doctrine ORM. It then covers using CouchDB as a document database, including its REST API, basics, and the TYPO3.CouchDB package. It notes limitations and introduces alternatives like Radmiraal.CouchDB that support multiple backends. Finally, it discusses future support for multiple persistence backends in Flow.
Amazon S3 is a cloud storage service that allows developers to store and retrieve any amount of data, at any time, from anywhere on the web. It provides scalable, reliable storage with interfaces for object storage and retrieval, and can be used with frameworks like Ruby on Rails through plugins and gems that integrate with S3. S3 offers inexpensive storage and data transfer rates starting at $0.15 per GB for storage and $0.10 per GB for data transfer.
Java SE 7 introduces several new and improved APIs. The key updates include:
1) New NIO2 libraries that provide better support for file metadata, symbolic links, directories, and asynchronous I/O. This includes a new Path class to replace File.
2) Updates to concurrency utilities and collections.
3) Enhancements to JDBC, XML processing, and client APIs for shaped windows and JLayers.
The document outlines the major new features in NIO2 including the Path class, file operations like copy/move, directory streams, file attributes, and file change notifications. It also briefly mentions updated concurrency and collections APIs.
This document provides an overview of different methods for persisting data in Android applications, including state information, preferences, files, SQLite databases, and content providers. It describes how to store and retrieve activity state information temporarily using bundles. It also explains how to use shared preferences, files, SQLite databases via SQLiteOpenHelper, and content providers via content resolvers to store and access application data permanently.
S3 & Glacier - The only backup solution you'll ever needMatthew Boeckman
This document discusses Amazon S3 and Glacier as backup solutions for Craftsy, an online training platform. It outlines why backups are important, especially for content businesses. The document then evaluates various backup options and explains why Amazon S3 and Glacier were chosen, providing details on how Craftsy uses multipart uploads, transfers files to Glacier for archiving, and utilizes versioning. Craftsy is able to manage all of its backups through code without manual tape swapping or hardware maintenance.
Optimizing Big Data to run in the Public CloudQubole
Qubole is a cloud-based platform that allows customers to easily run Hadoop and Spark clusters on AWS for big data analytics. It optimizes performance and reduces costs through techniques like caching data in S3 for faster access, using spot instances, and directly writing query outputs to S3. The document discusses Qubole's features, capabilities, and how it provides an easier way for more users like data scientists and analysts to access and query big data compared to building and managing Hadoop clusters themselves.
This document discusses various ways that Microsoft Azure storage and services can be used to enhance SQL Server deployments and provide additional capabilities. It begins with an introduction to Azure Blob storage and how it can be used for backups and disaster recovery. It then covers managed backups in Azure, using Azure storage for database files, configuring a cloud witness for failover clusters, hybrid partitioning to archive old data to Azure, stretch databases as an archival solution, and creating availability group replicas in Azure. The presentation provides examples and demos of configuring each of these capabilities with Azure and SQL Server.
Open Writing! Collaborative Authoring for CloudStack Documentation by Jessica...buildacloud
The document provides information about Apache CloudStack's documentation process and community. It discusses where the documentation website and source code repository are located. It describes how documentation is authored in modular Docbook XML files and built using Publican. It outlines the processes for documentation reviews, tracking bugs in Jira, and continuous integration builds with Jenkins. The document invites readers to get involved and contribute as documentation contributors.
The document provides information about Apache CloudStack's documentation process and community. It discusses where the documentation website and source code repository are located. It describes how documentation is authored in modular Docbook XML files and built using Publican. It outlines the processes for documentation reviews, tracking bugs in Jira, and continuous integration builds with Jenkins. The document invites readers to get involved and contribute as documentation contributors.
The Role of Atom/AtomPub in Digital Archive Services at The University of Tex...Peter Keane
The document discusses the role of Atom and AtomPub in the Digital Archive Services at the University of Texas at Austin (DASe). It describes how DASe uses Atom to represent items and collections as feeds. It also uses AtomPub to enable the creation, editing and deletion of items through RESTful web services. The document provides examples of how DASe, a simple uploader application, eLucy.org, and Blackboard have integrated with DASe using its Atom/AtomPub APIs.
12 core technologies you should learn, love, and hate to be a 'real' technocratlinoj
Presentation at PodCamp New Hampshire 2009
A "dim sum" (light sampling) of core technologies which everyone who considers themselves a "technocrat" should have some understanding and appreciation. Since there's a lot to cover, each topic will move pretty quickly, keeping the descriptions at a conceptual level.
Corporate-informatica-training-in-mumbaiUnmesh Baile
Vibrant Technologies is headquarted in Mumbai,India.We are the best Informatica training provider in Navi Mumbai who provides Live Projects to students.We provide Corporate Training also.We are Best Informatica classes in Mumbai according to our students and corporates
Corporate-informatica-training-in-mumbaiUnmesh Baile
Vibrant Technologies is headquarted in Mumbai,India.We are the best Informatica training provider in Navi Mumbai who provides Live Projects to students.We provide Corporate Training also.We are Best Informatica classes in Mumbai according to our students and corporates
Introduction to the basics of Information Retrieval (IR) with an emphasis on Apache Solr/Lucene. A lecture I gave during the JOSA Data Science Bootcamp.
Drupal 8 configuration management
Video of the presentation: http://2014.drupalcampmsk.ru/node/44 (Russian)
You can also check my article on this topic: http://amazeelabs.com/node/1093 (English)
Alexander Tkachev @ Amazee Labs
DrupalConf Moscow 2014
Similar to Django Files — A Short Talk (slides only) (20)
An introduction to git, assuming very little. I introduce some core concepts, the commands used to work with them, and briefly touch on Github flow (interpreted in quite a specific way) and recap the commands used for that.
The examples could be used as exercises for a class learning git live, with a bit of fleshing out.
IA Isn't New, or: What would Samuel Pepys' website look like?James Aylett
A poster presentation from Euro IA 2007, treating aspects of Pepys' life and work as targets for Information Architecture processes, to see what we can learn or identify for further thought and work. Or, as the introduction has it:
An ENTERTAINING and INFORMATIVE look at a SINGULAR person of NEAR ANTIQUITY, in the hope that we might learn MORE ABOUT OURSELVES.
The word "blockers" may not be helpful, but further, raising them only in standup will miss a lot of them — and hence a lot of opportunity for the team to improve its processes.
Git provides powerful tools for working with its "tree" of commits; one of them is rebase. A quick look at some of the basic (non-interactive) features.
What should git commits look like? How should comments work? A brief review of some good practices, complete with examples where I've made mistakes myself.
/dev/fort: you can build it in a week @emwJames Aylett
Imagine a place with no distractions – no IM, no Twitter, in fact no internet access at all. Within, a dozen or more developers, designers, thinkers and doers. And a lot of a food. Now imagine that place is a fort. I talk about why anyone would want to go on holiday to do their day job, the bits of the internet we had to rebuild to work without the internet, and some tips you can use even when you don't have a fort.
This document discusses the use of Dragon NaturallySpeaking dictation software. It explains how Dragon works by listening to a microphone and transcribing speech to text. It keeps an internal representation of text that allows for editing by voice commands. The document outlines some challenges with automatic capitalization and syncing edits between Dragon and applications. It also covers using the mouse and browser by voice, as well as customizing commands. In implications for web design, it warns that autoformatting can cause issues and advocates for forgiveness of errors in voice dictation.
OGN presentation from February 2011 on some things we did okay while building Spacelog. Accompanied a similarly short talk by Andrew Godwin on some of the technical choices we made, and whether they were…wise.
5 Heresies for a Better World: some playful challenges to everyone's assumptions about building for the modern web.
(From some time back in 2008, so some of the references have been forgotten by now. The points about having to think, and not just following the crowd without thinking, and cats being evil and about to make us all obsolete slaves, are still pretty relevant thought.)
Five class-based views everyone has written by nowJames Aylett
This document discusses the use of class-based views in Django and some challenges that arise when implementing more complex view logic compared to function-based views. It introduces five class-based views for common CRUD operations and describes additional mixins and custom views created to address issues like creating objects that are related to or bound by other objects, updating multiple related objects at once, and paginating child objects on a detail view. Additional topics like permissions are also briefly mentioned.
Using Query Store in Azure PostgreSQL to Understand Query PerformanceGrant Fritchey
Microsoft has added an excellent new extension in PostgreSQL on their Azure Platform. This session, presented at Posette 2024, covers what Query Store is and the types of information you can get out of it.
The Rising Future of CPaaS in the Middle East 2024Yara Milbes
Explore "The Rising Future of CPaaS in the Middle East in 2024" with this comprehensive PPT presentation. Discover how Communication Platforms as a Service (CPaaS) is transforming communication across various sectors in the Middle East.
What to do when you have a perfect model for your software but you are constrained by an imperfect business model?
This talk explores the challenges of bringing modelling rigour to the business and strategy levels, and talking to your non-technical counterparts in the process.
Malibou Pitch Deck For Its €3M Seed Roundsjcobrien
French start-up Malibou raised a €3 million Seed Round to develop its payroll and human resources
management platform for VSEs and SMEs. The financing round was led by investors Breega, Y Combinator, and FCVC.
E-Invoicing Implementation: A Step-by-Step Guide for Saudi Arabian CompaniesQuickdice ERP
Explore the seamless transition to e-invoicing with this comprehensive guide tailored for Saudi Arabian businesses. Navigate the process effortlessly with step-by-step instructions designed to streamline implementation and enhance efficiency.
Project Management: The Role of Project Dashboards.pdfKarya Keeper
Project management is a crucial aspect of any organization, ensuring that projects are completed efficiently and effectively. One of the key tools used in project management is the project dashboard, which provides a comprehensive view of project progress and performance. In this article, we will explore the role of project dashboards in project management, highlighting their key features and benefits.
14 th Edition of International conference on computer visionShulagnaSarkar2
About the event
14th Edition of International conference on computer vision
Computer conferences organized by ScienceFather group. ScienceFather takes the privilege to invite speakers participants students delegates and exhibitors from across the globe to its International Conference on computer conferences to be held in the Various Beautiful cites of the world. computer conferences are a discussion of common Inventions-related issues and additionally trade information share proof thoughts and insight into advanced developments in the science inventions service system. New technology may create many materials and devices with a vast range of applications such as in Science medicine electronics biomaterials energy production and consumer products.
Nomination are Open!! Don't Miss it
Visit: computer.scifat.com
Award Nomination: https://x-i.me/ishnom
Conference Submission: https://x-i.me/anicon
For Enquiry: Computer@scifat.com
Why Apache Kafka Clusters Are Like Galaxies (And Other Cosmic Kafka Quandarie...Paul Brebner
Closing talk for the Performance Engineering track at Community Over Code EU (Bratislava, Slovakia, June 5 2024) https://eu.communityovercode.org/sessions/2024/why-apache-kafka-clusters-are-like-galaxies-and-other-cosmic-kafka-quandaries-explored/ Instaclustr (now part of NetApp) manages 100s of Apache Kafka clusters of many different sizes, for a variety of use cases and customers. For the last 7 years I’ve been focused outwardly on exploring Kafka application development challenges, but recently I decided to look inward and see what I could discover about the performance, scalability and resource characteristics of the Kafka clusters themselves. Using a suite of Performance Engineering techniques, I will reveal some surprising discoveries about cosmic Kafka mysteries in our data centres, related to: cluster sizes and distribution (using Zipf’s Law), horizontal vs. vertical scalability, and predicting Kafka performance using metrics, modelling and regression techniques. These insights are relevant to Kafka developers and operators.
DECODING JAVA THREAD DUMPS: MASTER THE ART OF ANALYSISTier1 app
Are you ready to unlock the secrets hidden within Java thread dumps? Join us for a hands-on session where we'll delve into effective troubleshooting patterns to swiftly identify the root causes of production problems. Discover the right tools, techniques, and best practices while exploring *real-world case studies of major outages* in Fortune 500 enterprises. Engage in interactive lab exercises where you'll have the opportunity to troubleshoot thread dumps and uncover performance issues firsthand. Join us and become a master of Java thread dump analysis!
How Can Hiring A Mobile App Development Company Help Your Business Grow?ToXSL Technologies
ToXSL Technologies is an award-winning Mobile App Development Company in Dubai that helps businesses reshape their digital possibilities with custom app services. As a top app development company in Dubai, we offer highly engaging iOS & Android app solutions. https://rb.gy/necdnt
Unveiling the Advantages of Agile Software Development.pdfbrainerhub1
Learn about Agile Software Development's advantages. Simplify your workflow to spur quicker innovation. Jump right in! We have also discussed the advantages.
UI5con 2024 - Bring Your Own Design SystemPeter Muessig
How do you combine the OpenUI5/SAPUI5 programming model with a design system that makes its controls available as Web Components? Since OpenUI5/SAPUI5 1.120, the framework supports the integration of any Web Components. This makes it possible, for example, to natively embed own Web Components of your design system which are created with Stencil. The integration embeds the Web Components in a way that they can be used naturally in XMLViews, like with standard UI5 controls, and can be bound with data binding. Learn how you can also make use of the Web Components base class in OpenUI5/SAPUI5 to also integrate your Web Components and get inspired by the solution to generate a custom UI5 library providing the Web Components control wrappers for the native ones.
UI5con 2024 - Boost Your Development Experience with UI5 Tooling ExtensionsPeter Muessig
The UI5 tooling is the development and build tooling of UI5. It is built in a modular and extensible way so that it can be easily extended by your needs. This session will showcase various tooling extensions which can boost your development experience by far so that you can really work offline, transpile your code in your project to use even newer versions of EcmaScript (than 2022 which is supported right now by the UI5 tooling), consume any npm package of your choice in your project, using different kind of proxies, and even stitching UI5 projects during development together to mimic your target environment.
Baha Majid WCA4Z IBM Z Customer Council Boston June 2024.pdfBaha Majid
IBM watsonx Code Assistant for Z, our latest Generative AI-assisted mainframe application modernization solution. Mainframe (IBM Z) application modernization is a topic that every mainframe client is addressing to various degrees today, driven largely from digital transformation. With generative AI comes the opportunity to reimagine the mainframe application modernization experience. Infusing generative AI will enable speed and trust, help de-risk, and lower total costs associated with heavy-lifting application modernization initiatives. This document provides an overview of the IBM watsonx Code Assistant for Z which uses the power of generative AI to make it easier for developers to selectively modernize COBOL business services while maintaining mainframe qualities of service.
10. The File family
• File — or ImageFile, if it might be an image
• ContentFile / SimpleUploadedFile in tests
• which have a different parameter order
16. • #15879 multipart/form-data filename=""
not handled as file
• #17955 Uploading a file without using django forms
• #18150 Uploading a file ending with a
backslash fails
• #20034 Upload handlers provide no way to retrieve
previously parsed POST variables
• #21588 "Modifying upload handlers on the fly"
documentation doesn't replicate internal magic
18. Files in the ORM
# orm-file.py
class Wub(models.Model):
infosheet = models.FileField()
>>> w = Wub(infosheet="relative/to/media/root.pdf")
>>> print w.infosheet.url
https://media.root/relative/to/media/root.pdf
>>> w.infosheet = ContentFile("A boring bit of text",
“file.txt")
>>> print w.infosheet.url
https://media.root/file.txt
19. • #5619 FileField and ImageField return the wrong path/url
before calling save_FOO_file()
• #10244 FileFields can't be set to NULL in the db
• #13809 FileField open method is only accepting 'rb' modes
• #14039 FileField special-casing breaks MultiValueField including a
FileField
• #13327 FileField/ImageField accessor methods throw unnecessary
exceptions when they are blank or null.
• #17224 determine and document the use of default option in context
of FileField
• #25547 refresh_from_db leaves FieldFile with reference to db_instance
20. Files in the ORM
# orm-file.py
class Wub(models.Model):
infosheet = models.FileField()
>>> w = Wub(infosheet="relative/to/media/root.pdf")
>>> print w.infosheet.url
http://media.root/relative/to/media/root.pdf
>>> w.infosheet = ContentFile("A boring bit of text",
“file.txt")
>>> print w.infosheet.url
http://media.root/file.txt
>>> w.infosheet = None
>>> print w.infosheet.url
21. Files in the ORM
# orm-file.py
class Wub(models.Model):
infosheet = models.FileField()
>>> w = Wub(infosheet="relative/to/media/root.pdf")
>>> print w.infosheet.url
http://media.root/relative/to/media/root.pdf
>>> w.infosheet = ContentFile("A boring bit of text",
“file.txt")
>>> print w.infosheet.url
http://media.root/file.txt
>>> w.infosheet = None
>>> print w.infosheet.url
>>> print type(w.infosheet)
FieldFile <class 'django.db.models.fields.files.FieldFile'>
22. FieldFile
• magical autoconversion for anything (within
reason)
• this happens using FileDescriptor classes
which, well, let’s just ignore that
27. • #15817 ImageField having
[width|height]_field set sytematically compute
the image dimensions in ModelForm validation
process
• #18543 Non image file can be saved to
ImageField
• #19215 ImageField's “Currently” and “Clear”
Sometimes Don't Appear
• #21548 Add the ability to limit file extensions for
ImageField and FileField
31. • #8307 ImageFile use of width_field and
height_field is slow with remote storage
backends
• #13750 ImageField accessing height or width
and then data results in "I/O operation on
closed file”
35. What can Storage do?
• oriented around files, rather than a general FS API
• open / save / delete / exists / size / path / url
• make an available name, ie one that doesn’t clash
• modified, created, accessed times
• … also listdir
37. Choosing storage
# models.py
from mystorage import BetterStorage
storage_instance = BetterStorage()
class MyModel(models.Model):
upload = models.FileField(
storage=storage_instance
)
38. • #9586 Shall upload_to return an urlencoded
string or not?
• #12157 FileSystemStorage does file I/O inefficiently, despite
providing options to permit larger blocksizes
• #15799 Document what exception should be raised when trying
to open non-existent file
• #21602 FileSystemStorage._save() Should Save to a Temporary
Filename and Rename to Attempt to be Atomic
• #23759 Storage.get_available_name should preserve all file
extensions, not just the first one
• #23832 Storage API should provide a timezone aware approach
39. Reasons to override
• Model fields with different options
• Different storage engine entirely
41. S3BotoStorage
• One of many in django-storages-redux
• Millions of options, somewhat undocumented
• configure with AWS_ACCESS_KEY_ID,
AWS_SECRET_ACCESS_KEY,
AWS_STORAGE_BUCKET_NAME
• defaults for the rest mostly sane
43. Protected S3 storage
protected_storage = S3BotoStorage(
acl='private',
querystring_auth=True,
querystring_expire=600,
# 10 minutes, try to ensure people
# won’t / can't share
)
model.field.url # works as expected
44. Code that uses storage
• Please test on both Windows and Linux/Unix
• Please test with something remote like S3Boto
• Please write your own tests to work with different
storage backends
53. • #23563 Make `staticfiles_storage` a public API
• #25484 static template tag outputs invalid HTML
if storage class's url() returns a URI with '&'
characters.
60. Cached (1.4) / Manifest (1.7)
• Cache uses the main cache, or a dedicated one
• Manifest writes a JSON manifest file to the
configured storage backend
61. The problem
<!-- hashed-assets.html -->
<script src=“/static/admin/js/
collapse.min.c1a27df1b997.js”>
<script src=“/admin/editorial/
article/2/autosave_variables.js">
<script src=“/static/autosave/js/
autosave.js”>
62. The problem
<!-- hashed-assets.html -->
<script src=“/static/admin/js/
collapse.min.c1a27df1b997.js”>
<script src=“/admin/editorial/
article/2/autosave_variables.js">
<script src=“/static/autosave/js/
autosave.js?v=2”>
68. • #18929 CachedFilesMixin is not compatible with S3BotoStorage
• #19528 CachedFilesMixin does not rewrite rules for css
selector with path
• #19670 CachedFilesMixin Doesn't Limit Substitutions to Extension Matches
• #20620 CachedFileMixin.post_process breaks when cache size is exceeded
• #21080 collectstatic post-processing fails for references inside comments
• #22353 CachedStaticFilesMixin lags in updating hashed names of other static files
referenced in CSS
• #22972 HashedFilesMixin.patterns should limit URL matches to their respective filetypes
• #24243 Allow HashedFilesMixin to handle file name fragments
• #24452 Staticfiles backends using HashedFilesMixin don't update CSS files' hash
when referenced media changes
• #25283 ManifestStaticFilesStorage does not works in edge cases while
importing url font-face with IE hack
69. Some options for 3PA
• Fiat: All 3PAs use staticfiles
• Shim: all 3PAs use the admin approach, wrapping
it in their own taglib. Duplication!
• Bless: move staticfiles into core and make the
simple `load static` the same as `load staticfiles`
• Weakly bless staticfiles so `load static` behaves
like the admin, and the admin static stuff goes
away, and everyone just uses `load static`
71. Widgets, Forms, Admin
• Widgets might have specific assets to render
properly: typically CSS & JS
• Forms might have specific assets to render properly,
too. They’re made out of widgets and some other bits,
so they use the same system
• Then individual admin screens (ModelAdmin) might
have specific assets as well; they have Forms which
have Widgets
• Amazingly this hasn’t escaped into View
72. This is a good thing
from django.contrib import admin
from django.contrib.staticfiles.templatetags.staticfiles
import static
class ArticleAdmin(admin.ModelAdmin):
# ...
class Media:
js = [
'//tinymce.cachefly.net/4.1/tinymce.min.js',
static('js/tinymce_setup.js'),
]
73. This isn’t a good thing
from django.contrib.staticfiles.templatetags.staticfiles
import static
from django.contrib.admin.templatetags.admin_static
import static
74. • #9357 Unable to subclass form Media class
• #12264 calendar.js depends on jsi18n but date widgets using
it do not specify as required media
• #12265 Media (js/css) collection strategy in Forms has no order dependence
concept
• #13978 Allow inline js/css in forms.Media
• #18455 Added hooks to Media for staticfiles app
• #21221 Widgets and Admin's Media should use the configured staticfiles
storage to create the right path to a file
• #21318 Clarify the ordering of the various Media classes
• #21987 Allow Media objects to have their own MEDIA_TYPES
• #22298 Rename Media to Static
75. Some options
• Fiat: all 3PAs use staticfiles explicitly
• Shim: all 3PAs use the admin approach explicitly
• Bless: move staticfiles into core;
Media.absolute_path uses its storage
backend
• Weakly bless staticfiles, ie
Media.absolute_path uses the admin trick
76. This world’s a mess anyway
• no convenient API to get (CSS, JS) media
• can’t dedupe between forms if you have many
on one page
77. This world’s a mess anyway
• no convenient API to get (CSS, JS) media
• can’t dedupe between forms if you have many
on one page
• some things are global, eg jQuery, and can’t
easily dedupe between a widget and a site-wide
library
• to say nothing of different versions
98. Plain Django
• Pipeline external to Django (use what you want)
• Hashes computed by staticfiles
• Sourcemap support is fiddly if you want hashes
99. django-compressor
• Integrated pipeline, supports precompilers &c
• Source files listed in templates
• Integrated hashing
• Can be used with staticfiles, but feels awkward
• Can support sourcemaps, via a plugin
100. django-pipeline
• Internal pipeline, supports precompilers &c
• Source to output mapping in Django settings
• Integrates with staticfiles better than compressor
• Hashing via staticfiles
• Doesn’t support sourcemaps directly
101. Django + webpack
• webpack-bundle-tracker + django-webpack-
loader (Owais Lone 2015)
• Pipeline run by Webpack, emits a mapping file
• Template tag to resolve the bundle name to a
URL relative to STATIC_ROOT
103. The future?
• pipeline builds named bundles into output files
• pipeline writes manifest.json: a mapping of
bundle name to output filename
• staticfiles storage reads in manifest.json on boot
• templates refer to the bundle name
• useful for staticfiles to be able to list static
directories (eg for node pipeline search paths)
104. Third-party apps
• can’t cooperate with your project’s pipeline
• don’t want to force a dependency on a pipeline
• so must precompile into files in your sdist
• possibly for staticfiles to sweep up (but we’ve
discussed this bit before)
106. What next?
• bless or semi-bless staticfiles?
• deprecate CachedStaticFilesStorage?
• document the boundaries of our hashing?
• rename? kill? expand? form.Media
• asset management / document external pipelines
• fix some bugs ;-)
107. • #9433 File locking broken on AFP mounts
• #17686 file.save crashes on unicode filename
• #18233 file_move_safe overwrites destination file
• #18655 Media files should be served using file
storage API
• #22961 StaticFilesHandler should not run
middleware on 404