Managing Big Data - what every IT Executive Needs to Know

1,969 views
1,565 views

Published on

Effectively managing ‘Big Data’ presents huge opportunities for IT to deliver business value. IT can show tremendous value to the business by having a well implemented big data program.

BUT, the IT Executive needs to understand the limits and impediments to our human ability to process information. Without properly accommodating for our limitations, we diminish the REAL value we can provide to the business.

Published in: Technology, Education
0 Comments
2 Likes
Statistics
Notes
  • Be the first to comment

No Downloads
Views
Total views
1,969
On SlideShare
0
From Embeds
0
Number of Embeds
1
Actions
Shares
0
Downloads
23
Comments
0
Likes
2
Embeds 0
No embeds

No notes for slide
  • Can anyone tell me the relationship between these three time periods?
  • 80% of time and $ on maint. And 20% on new stuff. 80% on Infrastructure (capex) and 20% on customer facing (opex).
  • Need to be clear on this.
  • I’m going to try to explain each one of these and then show you some tactics you can apply to counter these impediments to success.
  • Our divided nature is partly to blame for our bad judgment. Broadly speaking, humans have a hasty and appetitive instinctual side, and a more patient, forward-looking reasoning side that supposedly provides some sort of supervision. Kahneman describes them as System 1 and System 2, respectively. The former provides most of the processing that gets us through our days. System 1’s snap judgments are often correct, but on more complex matters it can too easily victimize us. It can be “primed” through the power of suggestion, for example. And it’s susceptible to mere repetition, which it credulously mistakes for veracity. System 2 is our conscious, more rational self, and ought to ask, for instance, whether we are sure there are very many male librarians. But it’s lazy and easily tired, often bestirring itself just enough to certify that System 1 was right after all.This new approach has three essential elements: 1. Autonomy – the desire to direct our own lives. 2. Mastery — the urge to get better and better at something that matters. 3. Purpose — the yearning to do what we do in the service of something larger than ourselves.
  • I tried to get statistics on how much of the US Population understands statistics – but found nothing ;-)
  • Imagine, for instance, a man described as meek, shy, tidy, and helpful. Is he more likely to be a librarian or a farmer? Most of us will answer librarian, thereby falling for what Kahneman calls the representativeness heuristic. It may be true that librarians tend to fit the description, but there are 20 times as many male farmers as male librarians in this country. So it’s much likelier that the man described grows food for eating rather than catalogues food for thought.
  • ISAT test story with my son.
  • ISAT test story
  • In our busy world, people can FREQUENTLY miss changes that are very important and seemingly obvious.
  • People have a lot of choices and distractions… how do you motivate them to participate in processing big data?
  • Here are some interesting facts of what happens on the Internet every 60 seconds..
  • Which one are you more motivated to read?
  • Timing is critical.
  • Is the overnight report going the way of the dinosaur? Predictive Analytics are KEY!
  • Patterns & Trends that are predictive in nature are key
  • Let’s get tactical
  • Have full working demo at our booth.
  • Let’s get tactical
  • Can anyone tell me the relationship between these three time periods?
  • Managing Big Data - what every IT Executive Needs to Know

    1. © 2012 PSC Group, LLC
    2. Big Data Pattern Quiz  12 Days  32 Years  32,000 Years© 2012 PSC Group, LLC
    3. Agenda – Big Data  Complexities of Terabyte Storage  Storage Array Networks  Ultra-Fast Networking Requirements  Data Warehouse Basics  Analytics Tool Recommendations  Ad-hoc Reporting  Back-up Strategies© 2012 PSC Group, LLC
    4. Agenda – Big Data    stop thinking like  a geek   © 2012 PSC Group, LLC
    5. © 2012 PSC Group, LLC
    6. For Production Our Focus needs to be on Information Consumption From Consumption© 2012 PSC Group, LLC
    7. We exist to help others make better decisions.© 2012 PSC Group, LLC 2011
    8. Real vs. Perceived Value If we just provide the INFORMATION…  Do we care if the message is received?  Do we care if the message is understood?  Do we care if the proper action is taken?  Are we JUST providing information or are we helping the business to achieve a result?© 2012 PSC Group, LLC
    9. © 2012 PSC Group, LLC
    10. What is our PARTNER Guiding the User Wisdom COMMUNICATOR Describing a Situation CONDUIT Delivering Information Knowledge Information© 2012 PSC Group, LLC
    11. What is our PARTNER Guiding the User Wisdom COMMUNICATOR Describing a Situation CONDUIT Delivering Information Knowledge Information© 2012 PSC Group, LLC
    12. What is our PARTNER Guiding the User Wisdom Better Relationship COMMUNICATOR Describing a Situation between Business & IT CONDUIT Delivering Information Knowledge Information© 2012 PSC Group, LLC
    13. Seems Logical… but it’s just not that easy 2010© 2012 PSC Group, LLC
    14. Impediments to Success  Statistics  Attention  Perception  Motivation  Extreme Speed  Information Overload© 2012 PSC Group, LLC
    15. Compelling Influences© 2012 PSC Group, LLC
    16. Statistics of Statistics  Who has taken a statistics class?  Who has applied the scientific method at work?  Who wishes their staff would?  Who has recently done a Chi-squared test?  Who has recently peformed a t-test?  Who has done a correlation analysis?  Who has done a regression analysis?© 2012 PSC Group, LLC
    17. A man is described as meek, shy, tidy and helpful… Is he more likely to be a librarian or a farmer?© 2012 PSC Group, LLC
    18. Statistics FAIL© 2012 PSC Group, LLC
    19. Statistics FAIL Don’t Assume the People with the Statistics Understand Statistics© 2012 PSC Group, LLC
    20. Statistics Success  Large Global Insurance Firm  Large Investments/Improvements in Network  Perceived Network Sluggishness by Users  Sr. Management Getting Negative Feedback  We Executed a Large Statistical Analysis  Compared Technical Data & User Surveys  Suprising & Statistically Significant Finding!© 2012 PSC Group, LLC
    21. Attention?© 2012 PSC Group, LLC
    22. Paying Attention? In our distracted world, people often miss critical changes© 2012 PSC Group, LLC
    23. What Letter Is This?© 2012 PSC Group, LLC
    24. What Letter Is This?© 2012 PSC Group, LLC
    25. Are you sure? T E C T© 2012 PSC Group, LLC
    26. Are you sure? T E CONTEXT is VERY IMPORTANT C T© 2012 PSC Group, LLC
    27. Motivation CONFLICTS© 2012 PSC Group, LLC
    28. In 60 Seconds…  1 new definition in urban dictionary  510,040 Facebook comments  1600+ reads on Scribd  1,700+ Firefox downloads  13,000+ hours of music streaming on Pandora  694,445 Google search queries  12,000+ new ads posted on Craigslist  168 million emails are sent  370,000+ minutes of voice calls on Skype  60+ new blogs  98,000+ Tweets  1,500+ new blog posts  320+ new Twitter accounts  70+ domains registered  100+ new LinkedIn accounts  600+ new YouTube videos  1 new associatedcontent article published  25+ hours of duration of new YouTube videos  6,600+ new pictures uploaded on Flikr  100+ questions asked on the Internet  50+ WordPress downloads  40+ questions answered on the Internet  125+ WordPress plugin downloads  13,000+ iPhone applications downloaded  695,000+ Facebook status updates  20,000+ new posts on Tumblr  79,364 Facebook wall posts© 2012 PSC Group, LLC
    29. Which one would you read?© 2012 PSC Group, LLC
    30. When making business decisions…© 2012 PSC Group, LLC
    31. It’s all about WISDOM predicting the KNOWLEDGE Future INFORMATION The VELOCITY Observing the Present processing the Past of Information is Increasing© 2012 PSC Group, LLC
    32. © 2012 PSC Group, LLC
    33. Information Overload© 2012 PSC Group, LLC
    34. © 2012 PSC Group, LLC
    35. © 2012 PSC Group, LLC
    36. CLARITY Context, Context, Context Business Processes & Time, Location, etc. DIGESTIBL E Patterns & Trends Predictive Analytics – Forward/Fast Focus DESIRABL E It’s all about TIME Velocity, Half-Life of Info. & Motivation RELEVANT Revealing Change Who’s keeping track while you are busy?© 2012 PSC Group, LLC
    37. Right TIME, Right PLACE, Right PERSON Technology alone does not provide context CONTEXT is the product of Environment & Information© 2010 PSC Group, LLC© 2012 PSC Group, LLC
    38. Accounts Receivable Clerk Customer Inside Sales - Quoting© 2012 PSC Group, LLC
    39. Location You were on GPS fire tonight! Tools Proximity Social Network© 2012 PSC Group, LLC 2010
    40. © 2012 PSC Group, LLC
    41. OVERVIEW CIO Project Evaluator If you wish to learn more about This simple tool can help you quantify the risk profile of a given project. It is not intended to be used as an innovative & practical ways to absolute scoring mechanism – if it is it will not work for you. What this tool can be used for - very effectively - is the leverage technology - contact us: evaluation of incremental or comparative risk between your project alternatives. In time, this tool can also be used PSC Group, LLC to see if your average risk profile is migrating lower or higher. This can be indicative of changing business Jim Vaselopulos conditions that are favorable or require attention from a political perspective. Perhaps the most useful application jimv@psclistens.com of this tool is how it can be used to verify that you are entering each project having considered the fundamentals. 847.517.7200 In this way, you can ensure that you are having the proper business dialogue at the onset of each investment. www.psclistens.com 2009 WORKSHEET CIOprojeval.revA CIO Project Evaluator What is this Project’s PROJECT NAME Risk Profile? effective executives focus only on tasks that move their company forward; everything else can wait! 10 The project has a significant ROI 10 No defined objectives for a win Positives (+) Negatives (-) 10 It helps grow the business 10 No supportive business sponsor 10x 10x 10 Is budgeted for success 10 Addresses a symptom not a cause 5 It helps the company scale profitably 5 Limited impact to line of business 5x 5x ! " #$" % #& ( % #) *+*, -) ( . )/01-) 2*3-4/ ! A ?%3. 0%: # %-. %* &/ %2 . /) %& . 0-% $" ) ; 5 It lowers business risk (interruption) 5 Requires cultural change for adoption # . <& % S % , /&( D( &* : & D<) % 3$% -. % 2x 2x ! " # # & # ) %+ * % # -. /# *-" & , * -$% 0-% ) % 1& ) ( . . 2 # %3( * % *6 &/7) -85) & 6 & -9% %% & -" & " &$% ) ) % ( ) # 1% ) *=%! " ) % & " ) /) % -. % % # 1# >/&2 % % * -% 0-% &1#3% $% % ( * ) , ( $% # &% -% . . -" $-& /1% & ( ) , -) 1% & ) / $% % ) % # & % 0$# ) $$%3( * % % /1) /% % * ( , + # -" -3, ( *; ( ) # . ( ( ) 450*% /% /7) # & : 3% -% ; /) <) : *%% # % 1) # 0$) -" $% & $% -. # 0$-/& % " ) %-%$% ) $-% % <) $-% %) /-& % ) $% ?% /. @( -$= %A $" . 0* ; ) % . -) 1% & -" ) % & * -) : ## ; -. # # ( # -3, . , ) %%-% 1% -. , . . /) * -" -% 1# >/&2 %$% . -% % &* % % & -" ) % * A -. $( ) # -" -% 50*% * <) /&>) % ( " . * >3% ( . -& -% % ) -) . T% ( 0$U 5 Does not require rollout or re-training 5 Duration > stability of business process 2 & -% , ) & -. % ) % $%. >% $% ) % & 2 &/7) -% : " # " %$% . -% # &*%C " & # -. % ) %) & ) 1% 2 % # , # -0/) %$% & -" ) % ) % ) -% " #) % ) % 0$# ) $$%$% . -% ) " & >% % % $7% <) /$) % /7) &, /$% ; & * & -" 5) /% B% ( # -3, ( = % -%$% ; * / ?/. -" $% ( # -" -% D2 $, : * -" ; # ; <# # & E# F 15( 6 3*789 : ( : V2 %&$) * , 0* $% # W . . 2 ) -&# # F G FHI % ) -% >%% ) % ?% # % /% I ! 9 ; 0$# ) $$%( D<# % -% &* % , . /-& -% % . -) % & -" ) % % /. @( -$% & & %$-) 1% K) ( -% M F NL % & ) / $% NO! % " ) % ) 3% . 0* ; ) % *-3% C $% $, 10/# & D2 . " >" 4. JF % & -3=% # $. # A $% 2 -. -" -% A , ) ! -" -%/) * # /) L 6 , + B% : -" $" 1% @ <X , $( *$-) $= . 2 % #2 # ( 0 1) /-& = % ?. /-0 & * % # >% >) ) /&* , . . /% ) ( &0$) % & 3% ?% ) % /. @( -$% R0) $-) 1% >% ) % I ! % ) /# 1% R0# % 0$# ) $$% <. * 2 ) -%-% D2 ) % " ) % ) 3% & % ) % & &2 . 0 -% 7) %P -) 3QD2 # $% *3% ; 2 . -" , ) /) 10/# -" JF , . /) /) ; # <) & &% : -" " <) -" * $-%) 2 It helps retain key employees/assets 2 Can not quantify success 1x 1x . ?%<&* ; * % $. 0/( ) $=% # " . , ) 1% & -" # 1# >/& % #*" ) * % $-) /% ) + ) /% $( 0$$# $% # % ) % 0$# ) $$% >& >% <) $-2 ) -%. $# /& $%-%% ) % " ) % ) 3% #*3# * 2 ) & # >?0*( " & >) = & #& ) /) %-% A $% -" -% $% & 2 : *% , ?. ; 1# . : -" -" ; /) /1# # ( 1) D. & &D2 : -" : *% ) 1% % % YZ[ = ] [ = ^__% [ : : : = $( *$-) $= . 2 % , # ( 2 Business process is well understood 2 Unrealistic expectations anywhere 2 Is using proven technology 2 No time/budget for POC or discovery - RISK PROFILE 1 Lowers IT costs 1 It’s work outside your comfort zone 1 Is mandated or for compliance 1 Using newer technology © 2008 Copyright PSC Group, LLC http://www.psclistens.com Based on the designs of David Seah 1 Good for morale 1 Getting there will be unpleasant http://www.davidseah.com 2009 WORKSHEET CIOprojeval.revA CIO Project Evaluator What is this Project’s PROJECT NAME Risk Profile? effective executives focus only on tasks that move their company forward; everything else can wait! 10 The project has a significant ROI 10 No defined objectives for a win Positives (+) Negatives (-) 10 It helps grow the business 10 No supportive business sponsor 10x 10x 10 Is budgeted for success 10 Addresses a symptom not a cause 5 It helps the company scale profitably 5 Limited impact to line of business 5x 5x 5 It lowers business risk (interruption) 5 Requires cultural change for adoption 2x 2x 5 Does not require rollout or re-training 5 Duration > stability of business process 2 It helps retain key employees/assets 2 Can not quantify success 1x 1x 2 Business process is well understood 2 Unrealistic expectations anywhere 2 Is using proven technology 2 No time/budget for POC or discovery - RISK PROFILE ` % ^__a% c % /. 0, Q G % bI d %c G 1 Lowers IT costs 1 It’s work outside your comfort zone 1 Is mandated or for compliance 1 Using newer technology © 2008 Copyright PSC Group, LLC http://www.psclistens.com Based on the designs of David Seah 1 Good for morale 1 Getting there will be unpleasant http://www.davidseah.com© 2012 PSC Group, LLC
    42. © 2012 PSC Group, LLC 2010
    43. © 2012 PSC Group, LLC
    44. © 2012 PSC Group, LLC
    45. © 2012 PSC Group, LLC
    46. © 2012 PSC Group, LLC
    47. CLARITY Context, Context, Context Business Processes & Time, Location, etc. DIGESTIBL E Patterns & Trends Predictive Analytics – Forward/Fast Focus DESIRABL E It’s all about TIME Velocity, Half-Life of Info. & Motivation RELEVANT Revealing Change Who’s keeping track while you are busy?© 2012 PSC Group, LLC
    48. Big Data Pattern Quiz  12 Days ≈ 1 Million Seconds  32 Years ≈ 1 Billion Seconds  32,000 Years ≈ 1 Trillion Seconds© 2012 PSC Group, LLC
    49. $100© 2012 PSC Group, LLC
    50. $10,000© 2012 PSC Group, LLC
    51. $1 Million© 2012 PSC Group, LLC
    52. $100 Million© 2012 PSC Group, LLC
    53. $1 Billion© 2012 PSC Group, LLC
    54. $1 Trillion© 2012 PSC Group, LLC
    55. $1 Trillion© 2012 PSC Group, LLC
    56. Our National Debt© 2012 PSC Group, LLC
    57. © 2012 PSC Group, LLC

    ×