Pitch to President of George Washington University on creating a School of Future-Oriented Hybrid Governance and a World Brain Institute. He never bothered to respond.
New lecture created for Texas A&M member Tarleton, a really great class focusing on internaitonal reality and what we can know about it and do about it.
One one "cult" brief that is said to be popular with Anonymous and Lutzsec -- I would be glad if that were true. Open Source Everything is now a meme and a mind-set (see my 2012 book), this was the beginning of my final 20 year push.
First presentation of the local to global range of gifts table that disintermediates, eliminates NGO waste and theft, and allows for meeting needs of all people through a data-driven sparse matrix that leveraging multiple individual humans to meet specific needs.
Pitch to President of George Washington University on creating a School of Future-Oriented Hybrid Governance and a World Brain Institute. He never bothered to respond.
New lecture created for Texas A&M member Tarleton, a really great class focusing on internaitonal reality and what we can know about it and do about it.
One one "cult" brief that is said to be popular with Anonymous and Lutzsec -- I would be glad if that were true. Open Source Everything is now a meme and a mind-set (see my 2012 book), this was the beginning of my final 20 year push.
First presentation of the local to global range of gifts table that disintermediates, eliminates NGO waste and theft, and allows for meeting needs of all people through a data-driven sparse matrix that leveraging multiple individual humans to meet specific needs.
"Hell is of the Mind, Heaven is on Earth", is the message from those who need immediate assistance from Military caught in Narcotics Trafficking, Nam Bordello & Blood Diamond Activity.
SOCIAL MEDIA - BIG BROTHER IS WATCHING YOUArshad Sharif
How Social media applications like google, facebook, twitter etc are compiling data
Uses of data for manipulating elections
Military uses of social media data
Slides for a talk for the School of Social and Political Sciences and Department of Communication, University of Indonesia, Jakarta, 21 April 2021. I was asked to discuss digital citizenship, and did so from the perspective of the Fifth Estate.
Similar to 2010 state of global intelligence at hackers (20)
My latest thinking on the future of intelligence for traditional intelligence communities (not be be confused with my latest thinking on the open source everything innovation hub). This is the invited keynote, there is also a workshop briefing.
Concept for healing the Americas by creating an Open Source Agency and a Multinational Decision Support Centre to get international relations and commerce back on a sound footing, which is say, evidence based rather than driven by corruption and ideology.
A more polished simple attempt to explain to the University of Maryland at College Park how they could become the hub for a world brain and a school of future-oriented hybrid governance. No joy.
The USA is hosed until such time as We the People eradicate the two-party tyranny, restore integrity to our electoral process, and demand that governance be transparent, truthful, and trustworthy.
By invitation of Stephen E. Arnold one of my IT heroes, put forward a few thoughts on real time information. Without Open Source Everything, the information sharing and sense-making we need to do is simply not possible.
Failed attempt to get the Undersecretary of Defense for Intelligence (today the Director of National Intelligence) to be serious about producing decision-support instead of simply spending money wantonly.
Offered in Beirut by invitation, lots of interest but UN bureaucracy, like the US Government political leadership, is absolutely not interested in the truth at any cost even if it lowers all other costs.
Nine books later most still do not get it -- secret intelligence is largely waste -- unprocessed technical collection that feeds Congressional pork, nothing more.
The Building Blocks of QuestDB, a Time Series Databasejavier ramirez
Talk Delivered at Valencia Codes Meetup 2024-06.
Traditionally, databases have treated timestamps just as another data type. However, when performing real-time analytics, timestamps should be first class citizens and we need rich time semantics to get the most out of our data. We also need to deal with ever growing datasets while keeping performant, which is as fun as it sounds.
It is no wonder time-series databases are now more popular than ever before. Join me in this session to learn about the internal architecture and building blocks of QuestDB, an open source time-series database designed for speed. We will also review a history of some of the changes we have gone over the past two years to deal with late and unordered data, non-blocking writes, read-replicas, or faster batch ingestion.
Enhanced Enterprise Intelligence with your personal AI Data Copilot.pdfGetInData
Recently we have observed the rise of open-source Large Language Models (LLMs) that are community-driven or developed by the AI market leaders, such as Meta (Llama3), Databricks (DBRX) and Snowflake (Arctic). On the other hand, there is a growth in interest in specialized, carefully fine-tuned yet relatively small models that can efficiently assist programmers in day-to-day tasks. Finally, Retrieval-Augmented Generation (RAG) architectures have gained a lot of traction as the preferred approach for LLMs context and prompt augmentation for building conversational SQL data copilots, code copilots and chatbots.
In this presentation, we will show how we built upon these three concepts a robust Data Copilot that can help to democratize access to company data assets and boost performance of everyone working with data platforms.
Why do we need yet another (open-source ) Copilot?
How can we build one?
Architecture and evaluation
Chatty Kathy - UNC Bootcamp Final Project Presentation - Final Version - 5.23...John Andrews
SlideShare Description for "Chatty Kathy - UNC Bootcamp Final Project Presentation"
Title: Chatty Kathy: Enhancing Physical Activity Among Older Adults
Description:
Discover how Chatty Kathy, an innovative project developed at the UNC Bootcamp, aims to tackle the challenge of low physical activity among older adults. Our AI-driven solution uses peer interaction to boost and sustain exercise levels, significantly improving health outcomes. This presentation covers our problem statement, the rationale behind Chatty Kathy, synthetic data and persona creation, model performance metrics, a visual demonstration of the project, and potential future developments. Join us for an insightful Q&A session to explore the potential of this groundbreaking project.
Project Team: Jay Requarth, Jana Avery, John Andrews, Dr. Dick Davis II, Nee Buntoum, Nam Yeongjin & Mat Nicholas
Adjusting OpenMP PageRank : SHORT REPORT / NOTESSubhajit Sahu
For massive graphs that fit in RAM, but not in GPU memory, it is possible to take
advantage of a shared memory system with multiple CPUs, each with multiple cores, to
accelerate pagerank computation. If the NUMA architecture of the system is properly taken
into account with good vertex partitioning, the speedup can be significant. To take steps in
this direction, experiments are conducted to implement pagerank in OpenMP using two
different approaches, uniform and hybrid. The uniform approach runs all primitives required
for pagerank in OpenMP mode (with multiple threads). On the other hand, the hybrid
approach runs certain primitives in sequential mode (i.e., sumAt, multiply).
Adjusting primitives for graph : SHORT REPORT / NOTESSubhajit Sahu
Graph algorithms, like PageRank Compressed Sparse Row (CSR) is an adjacency-list based graph representation that is
Multiply with different modes (map)
1. Performance of sequential execution based vs OpenMP based vector multiply.
2. Comparing various launch configs for CUDA based vector multiply.
Sum with different storage types (reduce)
1. Performance of vector element sum using float vs bfloat16 as the storage type.
Sum with different modes (reduce)
1. Performance of sequential execution based vs OpenMP based vector element sum.
2. Performance of memcpy vs in-place based CUDA based vector element sum.
3. Comparing various launch configs for CUDA based vector element sum (memcpy).
4. Comparing various launch configs for CUDA based vector element sum (in-place).
Sum with in-place strategies of CUDA mode (reduce)
1. Comparing various launch configs for CUDA based vector element sum (in-place).
Global Situational Awareness of A.I. and where its headedvikram sood
You can see the future first in San Francisco.
Over the past year, the talk of the town has shifted from $10 billion compute clusters to $100 billion clusters to trillion-dollar clusters. Every six months another zero is added to the boardroom plans. Behind the scenes, there’s a fierce scramble to secure every power contract still available for the rest of the decade, every voltage transformer that can possibly be procured. American big business is gearing up to pour trillions of dollars into a long-unseen mobilization of American industrial might. By the end of the decade, American electricity production will have grown tens of percent; from the shale fields of Pennsylvania to the solar farms of Nevada, hundreds of millions of GPUs will hum.
The AGI race has begun. We are building machines that can think and reason. By 2025/26, these machines will outpace college graduates. By the end of the decade, they will be smarter than you or I; we will have superintelligence, in the true sense of the word. Along the way, national security forces not seen in half a century will be un-leashed, and before long, The Project will be on. If we’re lucky, we’ll be in an all-out race with the CCP; if we’re unlucky, an all-out war.
Everyone is now talking about AI, but few have the faintest glimmer of what is about to hit them. Nvidia analysts still think 2024 might be close to the peak. Mainstream pundits are stuck on the wilful blindness of “it’s just predicting the next word”. They see only hype and business-as-usual; at most they entertain another internet-scale technological change.
Before long, the world will wake up. But right now, there are perhaps a few hundred people, most of them in San Francisco and the AI labs, that have situational awareness. Through whatever peculiar forces of fate, I have found myself amongst them. A few years ago, these people were derided as crazy—but they trusted the trendlines, which allowed them to correctly predict the AI advances of the past few years. Whether these people are also right about the next few years remains to be seen. But these are very smart people—the smartest people I have ever met—and they are the ones building this technology. Perhaps they will be an odd footnote in history, or perhaps they will go down in history like Szilard and Oppenheimer and Teller. If they are seeing the future even close to correctly, we are in for a wild ride.
Let me tell you what we see.
Learn SQL from basic queries to Advance queriesmanishkhaire30
Dive into the world of data analysis with our comprehensive guide on mastering SQL! This presentation offers a practical approach to learning SQL, focusing on real-world applications and hands-on practice. Whether you're a beginner or looking to sharpen your skills, this guide provides the tools you need to extract, analyze, and interpret data effectively.
Key Highlights:
Foundations of SQL: Understand the basics of SQL, including data retrieval, filtering, and aggregation.
Advanced Queries: Learn to craft complex queries to uncover deep insights from your data.
Data Trends and Patterns: Discover how to identify and interpret trends and patterns in your datasets.
Practical Examples: Follow step-by-step examples to apply SQL techniques in real-world scenarios.
Actionable Insights: Gain the skills to derive actionable insights that drive informed decision-making.
Join us on this journey to enhance your data analysis capabilities and unlock the full potential of SQL. Perfect for data enthusiasts, analysts, and anyone eager to harness the power of data!
#DataAnalysis #SQL #LearningSQL #DataInsights #DataScience #Analytics
06-04-2024 - NYC Tech Week - Discussion on Vector Databases, Unstructured Data and AI
Round table discussion of vector databases, unstructured data, ai, big data, real-time, robots and Milvus.
A lively discussion with NJ Gen AI Meetup Lead, Prasad and Procure.FYI's Co-Found
Levelwise PageRank with Loop-Based Dead End Handling Strategy : SHORT REPORT ...Subhajit Sahu
Abstract — Levelwise PageRank is an alternative method of PageRank computation which decomposes the input graph into a directed acyclic block-graph of strongly connected components, and processes them in topological order, one level at a time. This enables calculation for ranks in a distributed fashion without per-iteration communication, unlike the standard method where all vertices are processed in each iteration. It however comes with a precondition of the absence of dead ends in the input graph. Here, the native non-distributed performance of Levelwise PageRank was compared against Monolithic PageRank on a CPU as well as a GPU. To ensure a fair comparison, Monolithic PageRank was also performed on a graph where vertices were split by components. Results indicate that Levelwise PageRank is about as fast as Monolithic PageRank on the CPU, but quite a bit slower on the GPU. Slowdown on the GPU is likely caused by a large submission of small workloads, and expected to be non-issue when the computation is performed on massive graphs.
4. HOPE 2008: www.oss.net/HOPE
See Also:
/AMAZON /BRAIN
/GNOME /HACKERS
/OPEN /PEACE
Home Base & HOPE 2010:
Phi Beta Iota Public Intelligence Blog
www.phibetaiota.net
5. HACK HUMANITY
CHALLENGE PART I:
END CORRUPTION
RESTORE HUMANITY
HACKING HUMANITY
CHALLENGE PART II:
EDUCATE POOR ONE CALL AT A
TIME, CREATE INFINITE WEALTH
6. Paradigms of Failure
• Government
• Military
• Law Enforcement
• Academia
• Business
• Media
• NGOs
• Civil Societies
9. Four Reforms in Need of OPEN
End Fraud,
Wage Peace,
Educate All
OSINT is 80
To 95% of the
Answer
Non-Partisan
Reality- Based
Budget
Demand Reform
Before 2010;
Home Rule Also
10.
11.
12.
13.
14. True Cost of One White CottonT-Shirt
Non-Organic, Foreign-Made, 200g/7oz
• Water : 570 gallons (45% irrigation)
• Energy: 8 kWh (machines), 11 to 29 gallons fuel
• Travel: 5,500 to 9,400+ miles
• Emissions: Nox, SO2, CO, CO2, N2O, volatile
compounds
• Toxins: 1-3g pesticides, diesel exhaust, heavy
metals (dyes)
• Child Labor: 17 countries, 50 cents/day
• Buy Online: http://true-cost.re-configure.org
15.
16.
17. Example
2. Passing
Tourist Texts
Need into DB
1. Need New Part
Here (1950’s
Rumanian Water
Pump
3. Rumanian
Engineer Offers Up
the Part
4. German Pays FedEx
5. Spanish
Tourist agrees
to deliver.
VIRTUAL GLOBAL
RANGE OF NEEDS &
GIFTS TABLE IN
ACTION
18. M4IS2 Applied to the Harmonization of Investment
For Any Given Place Across Weeks, Months, Years, Decades
19. AUSTRALIA: timber hauling trucks
CHINA: road construction
FRANCE: airport construction
GREECE: new shipping pier, one ship
INDIA: local call center
INDONESIA: open access
KOREA: free Internet
MALAYSIA: teachers
NORWAY: free cell phones
USA: timber processing technology
VIET-NAM: hotel development
EAST TIMOR: absolute promise of peace
and stability at village level
20. DATA PATHOLOGIES THE CURE
• Forbidden Knowledge
• Lost History
• Manufacturing Consent
• Missing Information
• Fog Facts
• Propaganda
• Rule by Secrecy
• Weapons of Mass Deception
• FORGOTTEN KNOWLEDGE
Integrity
26. US$ 2-3B/Yr at Full Capacity,
US$125M/Yr start, OMB OK
TWENTY YEARS OF TOUGH—VERY TOUGH—FIGHTING BEHIND THE SCENES AND IN PUBLIC
Page 413
Official
Report
27. White House & Congress
NOT Working in the Public
Interest—Take Power Back
Non-Violent Intelligence
To End Corruption and
Connect/Educate the Poor
No Words.
Larger figure depicts World Brain in still larger context of the cosmos.
Pig represents corruption in our governance and thinking.
All of my books are free online, and on sale at Amazon. From twelve to six today and tomorrow I will be offering personally-inscribed copies of this new book, and my first book, ON INTELLIGENCE: Spies & Secrecy in an Open World, for sale at cost--$20 for each.
This is the pre-quel book with 55 authors including Yochai Benkler and Tom Atlee and the former Prime Minister of Canada, and as with all books I publish it is also available free online, this one at www.oss.net/CIB.
You can access everything I refer to—not just my own work but the work of 750 others over 22 years—via Phi Beta Iota the Public Intelligence Blog.
The short-cuts are worth a quick look.
This is what I am going to talk about very briefly, leaving time for questions. Tomorrow night I will do SPY IMPROV, it generally lasts four hours but I would be glad to go to six so I can drive home after the sun comes up.
In a nutshell, Humanity has been killed by immoral capitalism, corrupt governance, and mediocre schools. People have been commoditized, marginalized, and enslaved by a system that fragments knowledge, concentrates wealth, and destroys both the Earth and our cultures.
You can field my short piece on “Paradigms of Failure” online. The eight tribes of intelligence as I call them have all failed to adapt, failed to retain their integrity, and failed to scale—that’s three strikes and out.
These are actual depictions of the US political scene. As you might imagine, international relations and international organizations are even worse.
Public intelligence—shared information and multicultural sense-making that is not secret—is how we overcome the paradigms of failure.
In the USA we have lost touch with what is done in our name and at our expense, at the same time that our government has lost touch with reality.
CLOSED LOOPS PROTECTED BY SECRECY AND LIES are a root cause of massive unnecessary entropy.
At least 50% of what our government does in our name is both wasteful and harmful to the public interest.
Global corruption starts here in the USA, at the top. We must stop funding a corrupt government.
9
I have long been critical of the insanity of spending $75 billion a year on secret sources and methods that obsess on a few “enemy states” that are not actually our enemies, just co-equal powers.
I devised this slide a year ago to advance public understanding of what it means for a nation to be intelligent.
We must adopt Buckminster Fuller’s goal of creating a world that works for 100% of humanity.
This is the strategy, and while I do not believe the United Nations is in any way shape or form suitable as any kind of government, I do believe that the UN can and should become the hub of the World Brain, and help all of us access the information we need to get a grip on reality, open up everything, and devise sustainable long-term initiatives for restoring the Earth and restoring Humanity.
This chart was inspired by the UN High Level Panel on Threats, Challenge, and Reform, which identified and prioritized the ten high-level threats to humanity—I and the other 25 co-founders of the Earth Intelligence Network then came up with the twelve core policies and the eight humanities that will determine the future of Earth.
Our government, corrupted by Wall Street and the military-industrial complex, is focused on the two red squares, and ignoring everything else.
This is a view I created for the new book, that shows how everything is connected. Energy is central here, but anything else could be central as well, from Water to Corruption.
What might be good for one part of the system can be very bad for all the other parts of the system. We have a stupid stove-piped government that refuses to be honest.
As I like to say, the truth at any cost lowers all other costs. Until We the People can get the truth on the table, we will continue to be farm animals.
This slide was created by JZ Liszkiewicz who is both the Executive Director of the Earth Intelligence Network, based here in NYC, and also the creative force behind Re-Configure.
“True Cost” is a very powerful meme that will help bring down predatory immoral capitalism, and spawn a new form of social capitalism that defines profit in human and ecological terms.
Each T-Shirt comes with a very detailed one-page summary of the findings from a year of research into this one topic—we need this for everything.
Once we have true cost information available to the public, we can eliminate most of the intermediaries who exist to profit from the distance between our money paid as taxes and the theft of that money by special interests.
I developed this with Joe Trippi and several others, and am certain that we can execute Participatory Budgeting here in the USA, at all levels.
We can not only get control over all funding that is to be spent in the public interest, we can also connect the one billion rich to the five billion poor directly, eliminating intermediaries such as the Red Cross that misdirect between 50% and 90% of our contributions, while enabling micro-giving “by name.”
This is a depiction of a Global to Local Range of Gifts Table that everyone can see and interact with online.
This is a crude illustration of the power of voluntary collaborative action using only the Internet as a service of common value to all.
I am totally blown away by the brilliance of the UNICEF Rapid SMS innovation project—it is clearly righteous, affordable, scalable, and universally applicable to all manner of public information sharing and sense-making needs.
The Internet now makes it possible to orchestrate sequential contributions toward a shared end, at any level in any domain.
This slide depicts how harmonization can be achieved for a specific location, for instance, East Timor (Timore –Leste).
Up to this point all organizations have been selfish and ignorant. That can end now. Not only can we share the burden of information collection and processing and multi-disciplinary sense-making, but we can PROFIT from doing so.
Trust lowers the cost of doing business. Sharing information is a perfect means for achieving trust.
Here again, a crude depiction of how intelligent information sharing and sense-making can lower the costs and increase the profits for all, while also avoiding the costs that come with illegal timber harvesting, lower-level insurgencies that arise out of a strong feeling of being cheated by international companies, and so on.
This is just one slide I give on a brief about missing information. Washington is operating on 2% of the available relevant information, in part because ideology has destroyed intelligence in government.
As a side note, adding Forgotten Knowledge, there has been a recent public discussion of how we can no longer manufacture the Trident missile. They lost critical files for a critical component.
My new book, free online, is about creating a United Nations Open-Source Decision-Support Information Network, or UNODIN, something I believe the Nordic countries would both understand and fund.
A Multinational Decision Support Centre or MDSC would deal only in open information that can be shared, but have the huge advantage of being competent in every language with two-way reachback to every Member nation.
The Earth Rescue Network is the ultimate means for our joining together to create a prosperous world at peace.
Here is how it looks both up close as a patch.
My intent, as all this gets organized, is to enable anyone who wishes to join the Earth Rescue Circle, both to call in Peace Targets and to help move items from point of donation to point of installation.
The UNICEF Rapid SMS innovation is clearly a vital part of the solution. I commend to your attention the annual STRONG ANGEL exercise, and the TOOZL toolkit that it offers free on a flashdrive.
The essence of my vision is that the five billion poor do not have time to go to schools, but they are intelligent and they can speak and read a language, so we should give them free cell phones and connect them to free knowledge.
Not only can they be educated one cell call at a time, and consequently create infinite stabilizing wealth, but they become a global early warning network for disease, crime, environmental degradation, and so on.
I look to the major demographic powers to realize that this is the only way they will elevate their poor with the added advantage of creating stabilizing wealth.
I want to end with three quick slides on the technical architecture. This is the first one, showing how an EarthGame with EarthBudget, both fed by the Earth Intelligence Network, can drive Earth Policy at every level on every topic.
I created this in the 1990’s.
Most of the world is till in Quadrant I, while many of you are in Quadrant II. I have lived in Quadrant III since 1992, and we all need to get to Quadrant IV.
A handful of us—roughly six dedicated senior professionals, have fought the US secret intelligence community since 1988 to get this little box, the Open Source Agency, into the very small government brain.
Although shown here as co-equal to the CIA and part of the US Intelligence Community, I believe we will succeed in making it a sister agency to the Broadcasting Board of Governors, operating under diplomatic auspices.
Given $125M to start, toward a Full Operating Capability of $3 billion, I can bury the secret world and redirect half of the $75 billion per year we waste now toward education and research, creating a Smart Nation.
My samizdat book is for sale at Amazon and also free online.
The reality is that the White House is theater, nothing more, and regardless of which of the two party tyranny might be “in power,” the reality is that neither the White House nor Congress are working in the public interest—they are there to distract us while Goldman Sachs and the Rothchilds continue to loot the world.
We can end corruption with non-violent intelligence that also connects and educates the poor.
That’s the brief. I will take 30 second questions and provide one to three minute answers for the balance of my hour, and I hope to see all of you at SPY IMPROVE tomorrow night, where anything goes, from 9-11 to extra-terrestial intelligence to how I would advise an honest president.