A broad overview of localisation progress in Africa, focusing on the history and progress made so far. Looking at the contribution of open source, Microsoft, Google and other players over the years.
The aim of the talk was to inform attendees to the ICANN International Domain Name workshop on the area of localisation. As well as to highlight how IDNs are part of the area of enabling localisation.
The Ulwazi Programme: a Model for Community Digital Libraries in South AfricaNiall McNulty
IFLA 2015: Session 174a
Born of changes in the political context and the policy environment, the Ulwazi Programme is a South African library
initiative that has been set up by the eThekwini Municipal Library’s Libraries and Heritage Department. Its aim is to
record and share, in both English and Zulu, the local histories and cultures of communities served by the municipal
library in the greater Durban area. The Programme does this by using the existing library infrastructure and freely
available social technologies to create a wiki, much like Wikipedia, but localised for the eThekwini Municipality. The
presentation further argues that the Ulwazi Programme advances the library’s efforts to be an inclusive institution
and contributes to social cohesion at a local level.
Interpersonal Communication Barriers to the Dissemination of Digital Literacy...Syed Mohsin Raja
With 1635 rationalised mother tongues and 23 constitutionally recognised languages, India sets the biggest example of diversity in terms of communication. By the North-Eastern part of India, by the parallels of the Himalayas and the Brahmaputra, communication takes another shape with its typical and separate language sets than from the mainland India.
This particular research tries to understand the communication barriers rising out of the diverse socio-cultural context prevalent in the North-Eastern India towards the espousal and success of digital literacy programmes. Further, this study stresses on the communicative understanding of the terms from the digital literacy domain. English being the primary language for digital literacy throughout India, the communicative understanding, interpretation and pretext of English on the ground of digital divide form the basis for this research.
A broad overview of localisation progress in Africa, focusing on the history and progress made so far. Looking at the contribution of open source, Microsoft, Google and other players over the years.
The aim of the talk was to inform attendees to the ICANN International Domain Name workshop on the area of localisation. As well as to highlight how IDNs are part of the area of enabling localisation.
The Ulwazi Programme: a Model for Community Digital Libraries in South AfricaNiall McNulty
IFLA 2015: Session 174a
Born of changes in the political context and the policy environment, the Ulwazi Programme is a South African library
initiative that has been set up by the eThekwini Municipal Library’s Libraries and Heritage Department. Its aim is to
record and share, in both English and Zulu, the local histories and cultures of communities served by the municipal
library in the greater Durban area. The Programme does this by using the existing library infrastructure and freely
available social technologies to create a wiki, much like Wikipedia, but localised for the eThekwini Municipality. The
presentation further argues that the Ulwazi Programme advances the library’s efforts to be an inclusive institution
and contributes to social cohesion at a local level.
Interpersonal Communication Barriers to the Dissemination of Digital Literacy...Syed Mohsin Raja
With 1635 rationalised mother tongues and 23 constitutionally recognised languages, India sets the biggest example of diversity in terms of communication. By the North-Eastern part of India, by the parallels of the Himalayas and the Brahmaputra, communication takes another shape with its typical and separate language sets than from the mainland India.
This particular research tries to understand the communication barriers rising out of the diverse socio-cultural context prevalent in the North-Eastern India towards the espousal and success of digital literacy programmes. Further, this study stresses on the communicative understanding of the terms from the digital literacy domain. English being the primary language for digital literacy throughout India, the communicative understanding, interpretation and pretext of English on the ground of digital divide form the basis for this research.
NCompass Live - April 26, 2017
http://nlc.nebraska.gov/ncompasslive/
In the context of the growing popularity of digital resources, declining reference and circulation transactions, and falling gate counts, collecting feedback about the unique needs and preferences of twenty-first century library users has never been more pertinent and important. But collecting that data can be expensive, especially for small libraries. This is particularly true in times of shrinking budgets.
Fortunately, there are plenty of free options when it comes to surveying your service population. Depending on your needs, you may choose a high tech option like Google Forms or a low tech option like a white marker board. Paul Meek Library at the University of Tennessee at Martin conducted user satisfaction surveys using both high tech and low tech options in the spring of 2016, the results of which were surprisingly similar.
In this presentation, we will discuss our experience conducting high tech and low tech (but all free!) surveys with an emphasis on the benefits and drawbacks of each to help you decide which option is best for your needs.
Presenters: Adam Clemons, Information Literacy Coordinator and Instruction Librarian; Jim Nance, Reference and Research Educator; Karen White, Outreach Librarian, Paul Meek Library, University of Tennessee at Martin.
Universal Design for Evaluation: Designing Evaluations to Include People with...Washington Evaluators
Washington Evaluators Brown Bag
by June Gothberg and Jennifer Sullivan-Sulewski
January 31, 2012
Evaluators are often tasked with insuring representative samples in their work. Many populations have been tagged as hard-to-reach and therefore make this task difficult in many evaluation efforts. People with disabilities and members of other vulnerable populations such as people who are homeless, chronically ill, economically disadvantaged, low literate, English language learners, elderly, and prisoners are frequently involved in or affected by evaluation efforts, regardless of the specific topic of the evaluation. Designing evaluations to include people with disabilities and other vulnerable populations is thus an essential skill for ensuring that these populations are fairly represented and included in the evaluation process. In the last two years, awareness has increased among evaluators at-large as to the importance of designing evaluation and data collection tools to include all people. Due to this, Universal Design has taken a forefront position. Out of this demand for assistance to increase capacity in this area, the idea for a Universal Design for Evaluation (UDE) checklist emerged. This session will introduce the seven principles of universal design, the UDE checklist, and their application to evaluation. Participants will add to their knowledge and skills to increase involvement for people with disabilities and other vulnerable populations in evaluation. The session will end with a discussion of next steps to increase partnerships between agencies, evaluators, and the American Evaluation Association.
June Gothberg is a researcher at Western Michigan University’s Connecting Careers Research Center where she is project technical assistance coordinator for the National Secondary Transition Technical Assistance Center focused on improving special education and transition services for students with disabilities.
Jennifer Sullivan-Sulewski is a Research Associate at the Institute for Community Inclusion, University of Massachusetts Boston. She has conducted or managed numerous research and evaluation projects, primarily related to day and employment services and supports for people with disabilities. She received her Ph.D. in Social Policy from Brandeis University in 2006.
Together they co-chair the Disabilities and Other Vulnerable Populations Topical Interest Group for the American Evaluation Association. Through this role, they co-produced the Universal Design for Evaluation model and the Universal Design for Evaluation checklist. This seminal model is fostering a paradigm to build capacity to include all individuals during the planning, implementation, analysis, and dissemination of evaluation.
Second of two public presentations given to Brooklyn Branch of the Cleveland Public Library, from August 20, 2016. See CPL150.org for more information.
Rhonda Johnson, Doreen Leavitt
and Robin Morales
Department of Health Sciences,
University of Alaska Anchorage
Delivered by Catherine Carry, Project Manager –NAHO 2009 National Conference
Easy & Effective Usability Testing at CodeMash 2012Carol Smith
Getting user feedback on your progress is key to making successful interfaces and it doesn’t have to take months. In this session you will learn how setting up regular usability tests can allow you to save time doing the studies and without sacrificing quality.
Learn strategies and techniques that can be used for making traditional and remote usability testing methods easier to plan and conduct. We will cover usability testing from planning through analysis, and ways to provide useful and usable recommendations to the team.
This session covers the following topics:
• Planning tips and tricks
• Recruiting methods
• Note taking and managing observers
• Specific tips for methods (Traditional, Rapid Iterative Testing and Evaluation (RITE)
• Specific tips for locations (in-person, on-site, remote)
• Analysis and sharing your findings
• Making usable recommendations
UXPA 2023: Disrupting Inaccessibility: Applying A11Y-Focused Discovery & Idea...UXPA International
Digital advances are being made at a rapid-fire pace, yet disability inclusivity continues to fall short of the digital revolution. As the number of people living with disabilities rises, the time to take digital accessibility to the next level is now. Let’s disrupt inaccessibility together! Come hear about a multi-part discovery research and ideation project informing foundational UX designs for our customers. You’ll get insights from our unique study, which are widely applicable across industries, and walk away with tips and inspiration to kick off your own accessibility-focused discovery and ideation. Only YOU can prevent inaccessibility – are you in?
Cross Cultural UX research - Best practices for international insightsUser Vision
User Vision Managing Director Chris Rourke presented at 2013 UX Scotland on the topic of international UX research providing tip and sharing experience in researching users from all over the world to shape a good User Experience
Willunga video
NBN enabled RTO capability framework
Organisational models
Project – objectives, participants, activities
Case studies
Storyboarding and video example
Lessons learned
Contact details
Inventory of Innovative Farmer Advisory Services using Information Communicat...Francois Stepman
Inventory of Innovative Farmer Advisory Services using Information Communications Technologies.
Inventaire des Services d’Information Agricoles Novateurs Utilisant les TIC
Mucemi Gakuru, Kristen Winters and François Stepman
FARA, 2009, 65 pages
This inventory was an attempt to document all known innovative farmer advisory services or systems, currently in design, in existence or recently completed in Africa. Entries included projects using Information Communications Technology (ICT) solutions or implementing ICT-based activities, institutions/groups providing services using ICTs as well as ICT solutions software providers, both at the national and regional level. While many of the entries are projects with a definitive beginning and end date providing one or two services, others are national or regional information systems providing many agricultural services using ICTs.
Library Engagement: a reference love story - Vickey Foggin (Ryde)
Tech Fast February - Kate Stewart (North Sydney)
Library Pop Ups in Local Community Centres - Paul Garbin (City of Sydney)
Invisible reference (parts 1 and 2) - Michelle Head (Albury) and Catherine Johnston (Coffs Harbour)
Better understand how to involve your target audiences during the design phase. Learn more about the research methods needed to ensure your target users will understand your product and can use it with ease before you invest time and money into the costly development phase.
Topics:
- Setting research objectives for the design phase
- Bringing your users into hands-on collaborative design activities such as paper-prototyping and card sorting
- Evaluating your design with users through usability testing, including in-person and remote testing
- Some of the tools available, including automated testing tools
Join Pew Research Center, The Jewish Federations of North America and The Neubauer Family Foundation for a virtual presentation and conversation about findings from the Center’s new 2020 survey of Jewish Americans, released May 11, 2021.
Reports of hate crimes and violence against Asian Americans have made headlines across the United States in the past year, prompting calls to increase the community’s visibility to combat negative stereotypes and misconceptions.
But large data gaps exist about Asians and their experiences in America. Why are those stories missing? And what can the research community do to bring them to light?
The Pew Research Center and a panel of distinguished experts for a look at recent research on Asian Americans as they explore how to close those data gaps and how better data can serve policymakers, the press, and advocates.
NCompass Live - April 26, 2017
http://nlc.nebraska.gov/ncompasslive/
In the context of the growing popularity of digital resources, declining reference and circulation transactions, and falling gate counts, collecting feedback about the unique needs and preferences of twenty-first century library users has never been more pertinent and important. But collecting that data can be expensive, especially for small libraries. This is particularly true in times of shrinking budgets.
Fortunately, there are plenty of free options when it comes to surveying your service population. Depending on your needs, you may choose a high tech option like Google Forms or a low tech option like a white marker board. Paul Meek Library at the University of Tennessee at Martin conducted user satisfaction surveys using both high tech and low tech options in the spring of 2016, the results of which were surprisingly similar.
In this presentation, we will discuss our experience conducting high tech and low tech (but all free!) surveys with an emphasis on the benefits and drawbacks of each to help you decide which option is best for your needs.
Presenters: Adam Clemons, Information Literacy Coordinator and Instruction Librarian; Jim Nance, Reference and Research Educator; Karen White, Outreach Librarian, Paul Meek Library, University of Tennessee at Martin.
Universal Design for Evaluation: Designing Evaluations to Include People with...Washington Evaluators
Washington Evaluators Brown Bag
by June Gothberg and Jennifer Sullivan-Sulewski
January 31, 2012
Evaluators are often tasked with insuring representative samples in their work. Many populations have been tagged as hard-to-reach and therefore make this task difficult in many evaluation efforts. People with disabilities and members of other vulnerable populations such as people who are homeless, chronically ill, economically disadvantaged, low literate, English language learners, elderly, and prisoners are frequently involved in or affected by evaluation efforts, regardless of the specific topic of the evaluation. Designing evaluations to include people with disabilities and other vulnerable populations is thus an essential skill for ensuring that these populations are fairly represented and included in the evaluation process. In the last two years, awareness has increased among evaluators at-large as to the importance of designing evaluation and data collection tools to include all people. Due to this, Universal Design has taken a forefront position. Out of this demand for assistance to increase capacity in this area, the idea for a Universal Design for Evaluation (UDE) checklist emerged. This session will introduce the seven principles of universal design, the UDE checklist, and their application to evaluation. Participants will add to their knowledge and skills to increase involvement for people with disabilities and other vulnerable populations in evaluation. The session will end with a discussion of next steps to increase partnerships between agencies, evaluators, and the American Evaluation Association.
June Gothberg is a researcher at Western Michigan University’s Connecting Careers Research Center where she is project technical assistance coordinator for the National Secondary Transition Technical Assistance Center focused on improving special education and transition services for students with disabilities.
Jennifer Sullivan-Sulewski is a Research Associate at the Institute for Community Inclusion, University of Massachusetts Boston. She has conducted or managed numerous research and evaluation projects, primarily related to day and employment services and supports for people with disabilities. She received her Ph.D. in Social Policy from Brandeis University in 2006.
Together they co-chair the Disabilities and Other Vulnerable Populations Topical Interest Group for the American Evaluation Association. Through this role, they co-produced the Universal Design for Evaluation model and the Universal Design for Evaluation checklist. This seminal model is fostering a paradigm to build capacity to include all individuals during the planning, implementation, analysis, and dissemination of evaluation.
Second of two public presentations given to Brooklyn Branch of the Cleveland Public Library, from August 20, 2016. See CPL150.org for more information.
Rhonda Johnson, Doreen Leavitt
and Robin Morales
Department of Health Sciences,
University of Alaska Anchorage
Delivered by Catherine Carry, Project Manager –NAHO 2009 National Conference
Easy & Effective Usability Testing at CodeMash 2012Carol Smith
Getting user feedback on your progress is key to making successful interfaces and it doesn’t have to take months. In this session you will learn how setting up regular usability tests can allow you to save time doing the studies and without sacrificing quality.
Learn strategies and techniques that can be used for making traditional and remote usability testing methods easier to plan and conduct. We will cover usability testing from planning through analysis, and ways to provide useful and usable recommendations to the team.
This session covers the following topics:
• Planning tips and tricks
• Recruiting methods
• Note taking and managing observers
• Specific tips for methods (Traditional, Rapid Iterative Testing and Evaluation (RITE)
• Specific tips for locations (in-person, on-site, remote)
• Analysis and sharing your findings
• Making usable recommendations
UXPA 2023: Disrupting Inaccessibility: Applying A11Y-Focused Discovery & Idea...UXPA International
Digital advances are being made at a rapid-fire pace, yet disability inclusivity continues to fall short of the digital revolution. As the number of people living with disabilities rises, the time to take digital accessibility to the next level is now. Let’s disrupt inaccessibility together! Come hear about a multi-part discovery research and ideation project informing foundational UX designs for our customers. You’ll get insights from our unique study, which are widely applicable across industries, and walk away with tips and inspiration to kick off your own accessibility-focused discovery and ideation. Only YOU can prevent inaccessibility – are you in?
Cross Cultural UX research - Best practices for international insightsUser Vision
User Vision Managing Director Chris Rourke presented at 2013 UX Scotland on the topic of international UX research providing tip and sharing experience in researching users from all over the world to shape a good User Experience
Willunga video
NBN enabled RTO capability framework
Organisational models
Project – objectives, participants, activities
Case studies
Storyboarding and video example
Lessons learned
Contact details
Inventory of Innovative Farmer Advisory Services using Information Communicat...Francois Stepman
Inventory of Innovative Farmer Advisory Services using Information Communications Technologies.
Inventaire des Services d’Information Agricoles Novateurs Utilisant les TIC
Mucemi Gakuru, Kristen Winters and François Stepman
FARA, 2009, 65 pages
This inventory was an attempt to document all known innovative farmer advisory services or systems, currently in design, in existence or recently completed in Africa. Entries included projects using Information Communications Technology (ICT) solutions or implementing ICT-based activities, institutions/groups providing services using ICTs as well as ICT solutions software providers, both at the national and regional level. While many of the entries are projects with a definitive beginning and end date providing one or two services, others are national or regional information systems providing many agricultural services using ICTs.
Library Engagement: a reference love story - Vickey Foggin (Ryde)
Tech Fast February - Kate Stewart (North Sydney)
Library Pop Ups in Local Community Centres - Paul Garbin (City of Sydney)
Invisible reference (parts 1 and 2) - Michelle Head (Albury) and Catherine Johnston (Coffs Harbour)
Better understand how to involve your target audiences during the design phase. Learn more about the research methods needed to ensure your target users will understand your product and can use it with ease before you invest time and money into the costly development phase.
Topics:
- Setting research objectives for the design phase
- Bringing your users into hands-on collaborative design activities such as paper-prototyping and card sorting
- Evaluating your design with users through usability testing, including in-person and remote testing
- Some of the tools available, including automated testing tools
Join Pew Research Center, The Jewish Federations of North America and The Neubauer Family Foundation for a virtual presentation and conversation about findings from the Center’s new 2020 survey of Jewish Americans, released May 11, 2021.
Reports of hate crimes and violence against Asian Americans have made headlines across the United States in the past year, prompting calls to increase the community’s visibility to combat negative stereotypes and misconceptions.
But large data gaps exist about Asians and their experiences in America. Why are those stories missing? And what can the research community do to bring them to light?
The Pew Research Center and a panel of distinguished experts for a look at recent research on Asian Americans as they explore how to close those data gaps and how better data can serve policymakers, the press, and advocates.
How Do OECD Forum Attendees Compare with Citizens Around the World on Views A...Pew Research Center
At the Organisation for Economic Co-operation and Development’s annual forum on Dec. 15, 2020, Director of Global Attitudes Research Richard Wike presented the results of an invitation-only poll of forum attendees about the COVID-19 pandemic and its impacts, the state of the global economy, the future of work, and cooperation between countries. The presentation compared the poll's results to findings from Pew Research Center surveys of general publics around the world.
These slides are from D’Vera Cohn’s presentation on a panel about covering the 2020 census at the Asian American Journalists Association 2019 convention in Atlanta.
How Do OECD Forum Attendees Compare With General Publics Around the World on ...Pew Research Center
At the Organisation for Economic Co-operation and Development’s annual Economic Forum on May 21, 2019, Director of Global Attitudes Research Richard Wike presented findings from a Pew Research Center survey of forum attendees.
How has populism disrupted the left right divide in western europePew Research Center
Director of Global Attitudes Research Richard Wike presented findings addressing the question of “How has populism disrupted the left-right divide in Western Europe?” in July 2018 at public events in Berlin, Brussels, and Madrid. The presentation is based on an in-depth Pew Research Center survey in eight European nations and is available on the Center’s website.
At the Organisation for Economic Co-operation and Development’s annual Economic Forum on May 29, 2018, Director of Global Economic Attitudes Bruce Stokes presented findings from a Pew Research Center survey of OECD Economic Forum attendees. The invitation-only online survey, which focused on views of economic conditions, faith in the multilateral system and the future of work, was completed by 269 Forum attendees between April 26 and May 22, 2018. Some of the results from this survey of thought leaders were compared to results from surveys of the public, which were conducted in 32 countries as part of the 2017 Global Attitudes Survey.
Thought Leader Survey: Issues Impacting the Transatlantic RelationshipPew Research Center
On March 24, 2017 at the German Marshall Fund’s annual Brussels Forum, Bruce Stokes, the director of global economic attitudes, presented Pew Research Center findings from a survey of Brussels Forum invitees and alumni of GMF’s Marshall Memorial Fellowship, Transatlantic Inclusion Leaders Network (TILN), Manfred Wörner Seminar (MWS), and the American Political Science Association Congressional Fellowship (APSA).
Origins and Destinations of Foreign Students in the United StatesPew Research Center
Associate Director of Global Migration and Demography Neil Ruiz presented findings on foreign students studying at colleges and universities in the United States on Wednesday, Jan. 31, in a public session at the Sheikh Saud Bin Saqr Al Qasimi Foundation for Policy Research in Ras al-Khaimah, United Arab Emirates.
Global Situational Awareness of A.I. and where its headedvikram sood
You can see the future first in San Francisco.
Over the past year, the talk of the town has shifted from $10 billion compute clusters to $100 billion clusters to trillion-dollar clusters. Every six months another zero is added to the boardroom plans. Behind the scenes, there’s a fierce scramble to secure every power contract still available for the rest of the decade, every voltage transformer that can possibly be procured. American big business is gearing up to pour trillions of dollars into a long-unseen mobilization of American industrial might. By the end of the decade, American electricity production will have grown tens of percent; from the shale fields of Pennsylvania to the solar farms of Nevada, hundreds of millions of GPUs will hum.
The AGI race has begun. We are building machines that can think and reason. By 2025/26, these machines will outpace college graduates. By the end of the decade, they will be smarter than you or I; we will have superintelligence, in the true sense of the word. Along the way, national security forces not seen in half a century will be un-leashed, and before long, The Project will be on. If we’re lucky, we’ll be in an all-out race with the CCP; if we’re unlucky, an all-out war.
Everyone is now talking about AI, but few have the faintest glimmer of what is about to hit them. Nvidia analysts still think 2024 might be close to the peak. Mainstream pundits are stuck on the wilful blindness of “it’s just predicting the next word”. They see only hype and business-as-usual; at most they entertain another internet-scale technological change.
Before long, the world will wake up. But right now, there are perhaps a few hundred people, most of them in San Francisco and the AI labs, that have situational awareness. Through whatever peculiar forces of fate, I have found myself amongst them. A few years ago, these people were derided as crazy—but they trusted the trendlines, which allowed them to correctly predict the AI advances of the past few years. Whether these people are also right about the next few years remains to be seen. But these are very smart people—the smartest people I have ever met—and they are the ones building this technology. Perhaps they will be an odd footnote in history, or perhaps they will go down in history like Szilard and Oppenheimer and Teller. If they are seeing the future even close to correctly, we are in for a wild ride.
Let me tell you what we see.
Adjusting OpenMP PageRank : SHORT REPORT / NOTESSubhajit Sahu
For massive graphs that fit in RAM, but not in GPU memory, it is possible to take
advantage of a shared memory system with multiple CPUs, each with multiple cores, to
accelerate pagerank computation. If the NUMA architecture of the system is properly taken
into account with good vertex partitioning, the speedup can be significant. To take steps in
this direction, experiments are conducted to implement pagerank in OpenMP using two
different approaches, uniform and hybrid. The uniform approach runs all primitives required
for pagerank in OpenMP mode (with multiple threads). On the other hand, the hybrid
approach runs certain primitives in sequential mode (i.e., sumAt, multiply).
Adjusting primitives for graph : SHORT REPORT / NOTESSubhajit Sahu
Graph algorithms, like PageRank Compressed Sparse Row (CSR) is an adjacency-list based graph representation that is
Multiply with different modes (map)
1. Performance of sequential execution based vs OpenMP based vector multiply.
2. Comparing various launch configs for CUDA based vector multiply.
Sum with different storage types (reduce)
1. Performance of vector element sum using float vs bfloat16 as the storage type.
Sum with different modes (reduce)
1. Performance of sequential execution based vs OpenMP based vector element sum.
2. Performance of memcpy vs in-place based CUDA based vector element sum.
3. Comparing various launch configs for CUDA based vector element sum (memcpy).
4. Comparing various launch configs for CUDA based vector element sum (in-place).
Sum with in-place strategies of CUDA mode (reduce)
1. Comparing various launch configs for CUDA based vector element sum (in-place).
The Building Blocks of QuestDB, a Time Series Databasejavier ramirez
Talk Delivered at Valencia Codes Meetup 2024-06.
Traditionally, databases have treated timestamps just as another data type. However, when performing real-time analytics, timestamps should be first class citizens and we need rich time semantics to get the most out of our data. We also need to deal with ever growing datasets while keeping performant, which is as fun as it sounds.
It is no wonder time-series databases are now more popular than ever before. Join me in this session to learn about the internal architecture and building blocks of QuestDB, an open source time-series database designed for speed. We will also review a history of some of the changes we have gone over the past two years to deal with late and unordered data, non-blocking writes, read-replicas, or faster batch ingestion.
STATATHON: Unleashing the Power of Statistics in a 48-Hour Knowledge Extravag...sameer shah
"Join us for STATATHON, a dynamic 2-day event dedicated to exploring statistical knowledge and its real-world applications. From theory to practice, participants engage in intensive learning sessions, workshops, and challenges, fostering a deeper understanding of statistical methodologies and their significance in various fields."
ViewShift: Hassle-free Dynamic Policy Enforcement for Every Data LakeWalaa Eldin Moustafa
Dynamic policy enforcement is becoming an increasingly important topic in today’s world where data privacy and compliance is a top priority for companies, individuals, and regulators alike. In these slides, we discuss how LinkedIn implements a powerful dynamic policy enforcement engine, called ViewShift, and integrates it within its data lake. We show the query engine architecture and how catalog implementations can automatically route table resolutions to compliance-enforcing SQL views. Such views have a set of very interesting properties: (1) They are auto-generated from declarative data annotations. (2) They respect user-level consent and preferences (3) They are context-aware, encoding a different set of transformations for different use cases (4) They are portable; while the SQL logic is only implemented in one SQL dialect, it is accessible in all engines.
#SQL #Views #Privacy #Compliance #DataLake
Techniques to optimize the pagerank algorithm usually fall in two categories. One is to try reducing the work per iteration, and the other is to try reducing the number of iterations. These goals are often at odds with one another. Skipping computation on vertices which have already converged has the potential to save iteration time. Skipping in-identical vertices, with the same in-links, helps reduce duplicate computations and thus could help reduce iteration time. Road networks often have chains which can be short-circuited before pagerank computation to improve performance. Final ranks of chain nodes can be easily calculated. This could reduce both the iteration time, and the number of iterations. If a graph has no dangling nodes, pagerank of each strongly connected component can be computed in topological order. This could help reduce the iteration time, no. of iterations, and also enable multi-iteration concurrency in pagerank computation. The combination of all of the above methods is the STICD algorithm. [sticd] For dynamic graphs, unchanged components whose ranks are unaffected can be skipped altogether.
Levelwise PageRank with Loop-Based Dead End Handling Strategy : SHORT REPORT ...Subhajit Sahu
Abstract — Levelwise PageRank is an alternative method of PageRank computation which decomposes the input graph into a directed acyclic block-graph of strongly connected components, and processes them in topological order, one level at a time. This enables calculation for ranks in a distributed fashion without per-iteration communication, unlike the standard method where all vertices are processed in each iteration. It however comes with a precondition of the absence of dead ends in the input graph. Here, the native non-distributed performance of Levelwise PageRank was compared against Monolithic PageRank on a CPU as well as a GPU. To ensure a fair comparison, Monolithic PageRank was also performed on a graph where vertices were split by components. Results indicate that Levelwise PageRank is about as fast as Monolithic PageRank on the CPU, but quite a bit slower on the GPU. Slowdown on the GPU is likely caused by a large submission of small workloads, and expected to be non-issue when the computation is performed on massive graphs.
4. Nokia Internal Use Only
SAMPLING CHALLENGES
• Drawing a true random representative sample
• Census data at times not detailed enough – smallest
sampling unit
• Latest/recent census data at times not available
• When a Sampling Frame is provide by the Country
Statistics Body [KNBS]
• Not updated; a listing exercise is required
• The frame is often overused:
• Everyone uses the same frame
• Meet other teams within the same sampling points
• Over-researched respondents - bias [expert
respondents]
• House/structure numbers sampled not easy to locate:
• Get erased hence rely on a local guide who may not be
doing the correct thing
• Tedious bureaucracy – timelines
• Expensive
5. Nokia Internal Use Only
Census Cartographic Mapping, which is a process of dividing the
whole country into smaller units called enumeration areas
6. Nokia Internal Use Only
SAMPLING CHALLENGES
• Using the random route technique:
• Infrastructure design challenge
• Streets not labeled
• Streets not there – Rural
• Houses not numbered
• Selecting starting points – landmarks
• Selecting direction from starting point
• Longitudinal studies challenge
• Locating respondents previously surveyed – physical
address
• Locating respondents previously surveyed – using
telephone contacts
• What has helped track respondents:
• CAPI
• GPS
• Regular follow up of respondents over phone where
possible (stay in touch)
7. Nokia Internal Use Only
Informal settlements with temporary structures pose sampling
challenges
8. Nokia Internal Use Only
Kenya is largely a rural country and the under developed
infrastructure also poses sampling challenges – no labeled streets /
roads, difficulty in findings reliable landmarks, etc.
10. Nokia Internal Use Only
LANGUAGE CHALLENGES
• Large number of ethnic groups that require translations
• Some oral languages for which written translation is not
possible
• Lose ‘pure’ respondents
• Respondents who cannot speak the translated languages may
have to be replaced with those who can thus biasing the
research
• Simultaneous translations – cannot guarantee standard
• Changes meaning of questions
• Translators start answering the questions posed on behalf
of the respondent instead of strictly translating
• Innovations to address oral languages challenge:
• Standardize simultaneous translations
• Enumerators who speak the language go through the
questionnaire together and agree how each question
translates into the given oral language
14. Nokia Internal Use Only
METHODOLOGICAL RESEARCH
• Census data
• Access of census data for sampling – to smallest unit
• Statistics Office sampling frame: accessible to public and
affordable
• Categorization/ classification of population [SEC/LSM]
• Need a system to update criteria
• An index to be used to measure – checking out some things
Benchmarks