Understanding Data: Gold Nuggets And Puzzle Pieces

Paul Lewis

I regularly use the colloquial phrase “nuggets of gold in a huge pot” when describing the value obtained from understanding and analyzing data.

It seems like an easy win. The phrase is well-known and highly digestible. Most people in the audience generally appreciate that gold has immense value, and there are whole industries that exist to mine this precious metal from a variety of mountains and streams. It’s also predictable that as you collect these precious nuggets, you won’t be able to carry them around given their collective weight, and a pot is as good as anything to store them. Plus, the whole leprechaun-esque vision it likely creates might bury the phrase in long-term memory for easy recall the next day with colleagues. Like, “I went to a seminar yesterday and this dude talked about value derived from analytics as being like nuggets of gold in a huge pot.” That’s helpful.

Occasionally, like here, I even blog about it. I find repetition to be tremendously valuable in retaining content. Additionally, I also find repetition to be tremendously valuable in retaining content. (Note: embedding subliminal messages in repetitive statements is also tremendously valuable, but I will get to that content later. Trust me, you won’t object.)

Unfortunately, as metaphors go, it’s extremely weak (especially considering pots are much more likely to hold coins versus nuggets.) Let me break it down so you see what I mean:

  • Data has value the instant it’s created, for as long as you hold it, until its demise
  • The final form of data could be deletion or decade-old archiving; the effect is the same
  • The value of data changes over time
  • Adding new data to existing data, more opportunity is created to discover a potentially endless series of value (Potentially)
  • This potential value could be expressed as an undetermined number of “nuggets of gold” (I guess, if you must)
  • The more data you have, the more nuggets of gold you could discover, and the more necessary a pot to hold them (That’s a stretch)
  • The more data you have, the more precise your statistical and mathematical models and more opportunity you will have to find more nuggets (Don’t buy it, sounds complex)

Getting the picture?

The fundamental problem with the metaphor is that I’m treating value-obtained as a direct representation of data-collected; i.e., you are storing various elements of a client, therefore hidden in one or more of elements is a single purposeful and valuable answer, hidden in the fields, row and columns:

  • Data, in the sense of a database, being a single field, in a single row, in a single column, is irrelevant. It carries no weight or value beyond the knowledge of collection. It lacks context and awareness. Whether static or variable, it tells no story and solves no problem.
  • Data, in the sense of unstructured data, bytes of binary information, carrys even less value. In fact, knowing that a single bit is only a small part of a greater whole, predetermines its unlikeliness to impact the entire picture.
  • Data, as a single point in time from a stream of information, is outdated the very nanosecond it’s used, as more current data takes its place, creating a new current reality.

The concept of “nuggets of gold,” by extension, then presumes a specific and direct answer to a question; or a direct and obvious correlation to an action:

  • How many toothpicks are in the container? 173
  • What color shirt matches best with my red pants? None, don’t wear red pants
  • What’s the name of that dude with the crazy beard in that class last year? For the last time HENRY!
  • If you were to spend $5 less, you would have an extra $5 in the bank
  • If we mix these two primary colors, you would have this one secondary
  • If I build more of this product, I will sell more of this product

Lesson learned: Individual elements of data possess little to no value

There is a reason why every company (including yours) has an enterprise information management (EIM) program and a chief data officer (CDO) responsible for stewardship of your most precious technological asset, data. As a reminder, EIM is an integrative discipline for structuring, describing, and governing information assets across organizational and technological boundaries to improve efficiency, promote transparency, and enable business insight. The program includes capabilities to store, protect, architect, manage risk and compliance, manage quality, classify, and organize data. A great EIM program focuses on how organizations derive insight and value from information, either from internal effectiveness and/or growth-oriented goals and activities.

A CDO, or VP of business intelligence, or manager of management information systems (MIS) understands that data, in its elemental form, does NOT equal value. They understand that value is derived from discovering patterns and appreciating the impact of change and time, and that data requires enrichment, not just discovery. The activity required to derive value is implemented in four capabilities:

  • Descriptive: MIS or reporting, focusing on hindsight (what has happened)
  • Diagnostic: Business intelligence or incident management, focusing on current-state insight or understanding “why” it happened
  • Predictive: Analytics combining models of previous data and application to new data, focusing on foresight (what will happen)
  • Prescriptive: Analytics and action, foresight algorithms to implement a business function

The EIM program also appreciates that the effort to create value focuses far less on finding a long-lost and specific piece of data, and instead focuses on studying patterns in static, changing, and moving information and researching correlations, causations, and theoretical application of mathematics and logic to create complex business value from data-centric components. Yes, it’s a science. It’s far less searching for a nugget of gold, and far more about determining that you could make money from gold jewelry… all from the same mine.

So here is my NEW metaphor

And for the sake of inconsistency, I’m not even going to use precious metals. Imagine a pile of random puzzle pieces. Each piece represents a single data point, collected from a variety of sources.

Before value can be obtained, preparatory activity is needed to curate and enrich data:

  • Extraction: Identify all the puzzle pieces in the house: under beds, in vacuum cleaners, in the dog bowl, etc. For data, discover all the sources of information: internally and externally, structured and unstructured, and classify.
  • Integration: Send out all the kids and parents to grab the pieces and bring them back to the pile. For data, connect to hundreds of sources for batch or real-time integration/ETL.
  • Enhancement and cleansing: Dust off each piece, glue back down the picture side, sharpen the edges, number the backs. For data, match and qualify, and add appropriate metadata.

This effort to convert raw data to content, and indescribable fields into describable objects, requires the capabilities of more than just a pile, a box of sorts.

A content platform (the box) allows organizations to bring together object storage (a place to put all data), data mobility (a means to abstract data from its sources), cloud gateways (ability to use multiple deployment models), and metadata (tagging and sophisticated search to create a tightly integrated, simple, and smart data intelligence solution.) You may have heard this being referred to as a “data lake.” I highly recommend this solution set, if you happen to be in the market.

For this new enhanced data set (puzzle pieces), contained in a content platform (puzzle box), the EIM value-creation activities can be described (it’s still the goal to find the Picasso):

  • Descriptive: Create a list of puzzle pieces, organized by shape/color/origin; determine which pieces closely resemble the palette of a master work of art
  • Diagnostic: visualize the current state of completing the puzzle; how far along is the process and/or discover missing pieces
  • Predictive: Given where we are in the process, and the remaining pieces still in the box, determine what picture we might be making and/or predict what might be the picture, even if we have missing pieces
  • Prescriptive: After having made dozens of pictures from these same puzzle pieces, guide the creation of existing and new completed puzzles

Both predictive and prescriptive analytics would use linear and non-linear algorithms (ways of thinking out the problem), would focus equally on the puzzle pieces that exist and the ones that are missing, and combine or use pieces from hundreds of potential sources to create hundreds of different works of art.

In a nutshell: The value obtained from understanding and analyzing data is not that you will find “nuggets of gold” of data or an individual puzzle piece that solves the problem. The value obtained from understanding and analyzing data is the millions of dollars in your bank account from building several masterpieces from all your individual puzzle pieces.

Learn how to derive more value from Data – The Hidden Treasure Inside Your Business.

Comments

Paul Lewis

About Paul Lewis

Paul Lewis is the Chief Technology Officer in Hitachi for the Americas, responsible for the leading technology trend mastery and evangelism, client executive advocacy, and external delivery of the Hitachi vision and strategy especially related to digital transformation and social innovation. Additionally, Paul contributes to field enablement of data intelligence and analytics; interprets and translates complex technology trends including cloud, mobility, governance, and information management; and represents the Americas region in the Global Technology Office, the Hitachi LTD R&D division. In his role of trusted advisor to the CIO community, Paul’s explicit goal is to ensure clients’ problems are solved and opportunities realized. Paul can be found at his blog, on Twitter, and on LinkedIn.

Data Analysts And Scientists More Important Than Ever For The Enterprise

Daniel Newman

The business world is now firmly in the age of data. Not that data wasn’t relevant before; it was just nowhere close to the speed and volume that’s available to us today. Businesses are buckling under the deluge of petabytes, exabytes, and zettabytes. Within these bytes lie valuable information on customer behavior, key business insights, and revenue generation. However, all that data is practically useless for businesses without the ability to identify the right data. Plus, if they don’t have the talent and resources to capture the right data, organize it, dissect it, draw actionable insights from it and, finally, deliver those insights in a meaningful way, their data initiatives will fail.

Rise of the CDO

Companies of all sizes can easily find themselves drowning in data generated from websites, landing pages, social streams, emails, text messages, and many other sources. Additionally, there is data in their own repositories. With so much data at their disposal, companies are under mounting pressure to utilize it to generate insights. These insights are critical because they can (and should) drive the overall business strategy and help companies make better business decisions. To leverage the power of data analytics, businesses need more “top-management muscle” specialized in the field of data science. This specialized field has lead to the creation of roles like Chief Data Officer (CDO).

In addition, with more companies undertaking digital transformations, there’s greater impetus for the C-suite to make data-driven decisions. The CDO helps make data-driven decisions and also develops a digital business strategy around those decisions. As data grows at an unstoppable rate, becoming an inseparable part of key business functions, we will see the CDO act as a bridge between other C-suite execs.

Data skills an emerging business necessity

So far, only large enterprises with bigger data mining and management needs maintain in-house solutions. These in-house teams and technologies handle the growing sets of diverse and dispersed data. Others work with third-party service providers to develop and execute their big data strategies.

As the amount of data grows, the need to mine it for insights becomes a key business requirement. For both large and small businesses, data-centric roles will experience endless upward mobility. These roles include data anlysts and scientists. There is going to be a huge opportunity for critical thinkers to turn their analytical skills into rapidly growing roles in the field of data science. In fact, data skills are now a prized qualification for titles like IT project managers and computer systems analysts.

Forbes cited the McKinsey Global Institute’s prediction that by 2018 there could be a massive shortage of data-skilled professionals. This indicates a disruption at the demand-supply level with the needs for data skills at an all-time high. With an increasing number of companies adopting big data strategies, salaries for data jobs are going through the roof. This is turning the position into a highly coveted one.

According to Harvard Professor Gary King, “There is a big data revolution. The big data revolution is that now we can do something with the data.” The big problem is that most enterprises don’t know what to do with data. Data professionals are helping businesses figure that out. So if you’re casting about for where to apply your skills and want to take advantage of one of the best career paths in the job market today, focus on data science.

I’m compensated by University of Phoenix for this blog. As always, all thoughts and opinions are my own.

For more insight on our increasingly connected future, see The $19 Trillion Question: Are You Undervaluing The Internet Of Things?

The post Data Analysts and Scientists More Important Than Ever For the Enterprise appeared first on Millennial CEO.

Comments

Daniel Newman

About Daniel Newman

Daniel Newman serves as the Co-Founder and CEO of EC3, a quickly growing hosted IT and Communication service provider. Prior to this role Daniel has held several prominent leadership roles including serving as CEO of United Visual. Parent company to United Visual Systems, United Visual Productions, and United GlobalComm; a family of companies focused on Visual Communications and Audio Visual Technologies. Daniel is also widely published and active in the Social Media Community. He is the Author of Amazon Best Selling Business Book "The Millennial CEO." Daniel also Co-Founded the Global online Community 12 Most and was recognized by the Huffington Post as one of the 100 Business and Leadership Accounts to Follow on Twitter. Newman is an Adjunct Professor of Management at North Central College. He attained his undergraduate degree in Marketing at Northern Illinois University and an Executive MBA from North Central College in Naperville, IL. Newman currently resides in Aurora, Illinois with his wife (Lisa) and his two daughters (Hailey 9, Avery 5). A Chicago native all of his life, Newman is an avid golfer, a fitness fan, and a classically trained pianist

When Good Is Good Enough: Guiding Business Users On BI Practices

Ina Felsheim

Image_part2-300x200In Part One of this blog series, I talked about changing your IT culture to better support self-service BI and data discovery. Absolutely essential. However, your work is not done!

Self-service BI and data discovery will drive the number of users using the BI solutions to rapidly expand. Yet all of these more casual users will not be well versed in BI and visualization best practices.

When your user base rapidly expands to more casual users, you need to help educate them on what is important. For example, one IT manager told me that his casual BI users were making visualizations with very difficult-to-read charts and customizing color palettes to incredible degrees.

I had a similar experience when I was a technical writer. One of our lead writers was so concerned with readability of every sentence that he was going through the 300+ page manuals (yes, they were printed then) and manually adjusting all of the line breaks and page breaks. (!) Yes, readability was incrementally improved. But now any number of changes–technical capabilities, edits, inserting larger graphics—required re-adjusting all of those manual “optimizations.” The time it took just to do the additional optimization was incredible, much less the maintenance of these optimizations! Meanwhile, the technical writing team was falling behind on new deliverables.

The same scenario applies to your new casual BI users. This new group needs guidance to help them focus on the highest value practices:

  • Customization of color and appearance of visualizations: When is this customization necessary for a management deliverable, versus indulging an OCD tendency? I too have to stop myself from obsessing about the font, line spacing, and that a certain blue is just a bit different than another shade of blue. Yes, these options do matter. But help these casual users determine when that time is well spent.
  • Proper visualizations: When is a spinning 3D pie chart necessary to grab someone’s attention? BI professionals would firmly say “NEVER!” But these casual users do not have a lot of depth on BI best practices. Give them a few simple guidelines as to when “flash” needs to subsume understanding. Consider offering a monthly one-hour Lunch and Learn that shows them how to create impactful, polished visuals. Understanding if their visualizations are going to be viewed casually on the way to a meeting, or dissected at a laptop, also helps determine how much time to spend optimizing a visualization. No, you can’t just mandate that they all read Tufte.
  • Predictive: Provide advanced analytics capabilities like forecasting and regression directly in their casual BI tools. Using these capabilities will really help them wow their audience with substance instead of flash.
  • Feature requests: Make sure you understand the motivation and business value behind some of the casual users’ requests. These casual users are less likely to understand the implications of supporting specific requests across an enterprise, so make sure you are collaborating on use cases and priorities for substantive requests.

By working with your casual BI users on the above points, you will be able to collectively understand when the absolute exact request is critical (and supports good visualization practices), and when it is an “optimization” that may impact productivity. In many cases, “good” is good enough for the fast turnaround of data discovery.

Next week, I’ll wrap this series up with hints on getting your casual users to embrace the “we” not “me” mentality.

Read Part One of this series: Changing The IT Culture For Self-Service BI Success.

Follow me on Twitter: @InaSAP

Comments

The Future Will Be Co-Created

Dan Wellers and Timo Elliott

 

Just 3% of companies have completed enterprise digital transformation projects.
92% of those companies have significantly improved or transformed customer engagement.
81% of business executives say platforms will reshape industries into interconnected ecosystems.
More than half of large enterprises (80% of the Global 500) will join industry platforms by 2018.

Link to Sources


Redefining Customer Experience

Many business leaders think of the customer journey or experience as the interaction an individual or business has with their firm.

But the business value of the future will exist in the much broader, end-to-end experiences of a customer—the experience of travel, for example, or healthcare management or mobility. Individual companies alone, even with their existing supplier networks, lack the capacity to transform these comprehensive experiences.


A Network Effect

Rather than go it alone, companies will develop deep collaborative relationships across industries—even with their customers—to create powerful ecosystems that multiply the breadth and depth of the products, services, and experiences they can deliver. Digital native companies like Baidu and Uber have embraced ecosystem thinking from their early days. But forward-looking legacy companies are beginning to take the approach.

Solutions could include:

  • Packaging provider Weig has integrated partners into production with customers co-inventing custom materials.
  • China’s Ping An insurance company is aggressively expanding beyond its sector with a digital platform to help customers manage their healthcare experience.
  • British roadside assistance provider RAC is delivering a predictive breakdown service for drivers by acquiring and partnering with high-tech companies.

What Color Is Your Ecosystem?

Abandoning long-held notions of business value creation in favor of an ecosystem approach requires new tactics and strategies. Companies can:

1.  Dispassionately map the end-to-end customer experience, including those pieces outside company control.

2.  Employ future planning tactics, such as scenario planning, to examine how that experience might evolve.

3.  Identify organizations in that experience ecosystem with whom you might co-innovate.

4.  Embrace technologies that foster secure collaboration and joint innovation around delivery of experiences, such as cloud computing, APIs, and micro-services.

5.  Hire, train for, and reward creativity, innovation, and customer-centricity.


Evolve or Be Commoditized

Some companies will remain in their traditional industry boxes, churning out products and services in isolation. But they will be commodity players reaping commensurate returns. Companies that want to remain competitive will seek out their new ecosystem or get left out in the cold.


Download the executive brief The Future Will be Co-Created.


Read the full article The Future Belongs to Industry-Busting Ecosystems.

Turn insight into action, make better decisions, and transform your business.  Learn how.

Comments

Dan Wellers

About Dan Wellers

Dan Wellers is founder and leader of Digital Futures at SAP, a strategic insights and thought leadership discipline that explores how digital technologies drive exponential change in business and society.

About Timo Elliott

Timo Elliott is an Innovation Evangelist for SAP and a passionate advocate of innovation, digital business, analytics, and artificial intelligence. He was the eighth employee of BusinessObjects and for the last 25 years he has worked closely with SAP customers around the world on new technology directions and their impact on real-world organizations. His articles have appeared in articles such as Harvard Business Review, Forbes, ZDNet, The Guardian, and Digitalist Magazine. He has worked in the UK, Hong Kong, New Zealand, and Silicon Valley, and currently lives in Paris, France. He has a degree in Econometrics and a patent in mobile analytics. 

Tags:

Blockchain: Much Ado About Nothing? How Very Wrong!

Juergen Roehricht

Let me start with a quote from McKinsey, that in my view hits the nail right on the head:

“No matter what the context, there’s a strong possibility that blockchain will affect your business. The very big question is when.”

Now, in the industries that I cover in my role as general manager and innovation lead for travel and transportation/cargo, engineering, construction and operations, professional services, and media, I engage with many different digital leaders on a regular basis. We are having visionary conversations about the impact of digital technologies and digital transformation on business models and business processes and the way companies address them. Many topics are at different stages of the hype cycle, but the one that definitely stands out is blockchain as a new enabling technology in the enterprise space.

Just a few weeks ago, a customer said to me: “My board is all about blockchain, but I don’t get what the excitement is about – isn’t this just about Bitcoin and a cryptocurrency?”

I can totally understand his confusion. I’ve been talking to many blockchain experts who know that it will have a big impact on many industries and the related business communities. But even they are uncertain about the where, how, and when, and about the strategy on how to deal with it. The reason is that we often look at it from a technology point of view. This is a common mistake, as the starting point should be the business problem and the business issue or process that you want to solve or create.

In my many interactions with Torsten Zube, vice president and blockchain lead at the SAP Innovation Center Network (ICN) in Potsdam, Germany, he has made it very clear that it’s mandatory to “start by identifying the real business problem and then … figure out how blockchain can add value.” This is the right approach.

What we really need to do is provide guidance for our customers to enable them to bring this into the context of their business in order to understand and define valuable use cases for blockchain. We need to use design thinking or other creative strategies to identify the relevant fields for a particular company. We must work with our customers and review their processes and business models to determine which key blockchain aspects, such as provenance and trust, are crucial elements in their industry. This way, we can identify use cases in which blockchain will benefit their business and make their company more successful.

My highly regarded colleague Ulrich Scholl, who is responsible for externalizing the latest industry innovations, especially blockchain, in our SAP Industries organization, recently said: “These kinds of use cases are often not evident, as blockchain capabilities sometimes provide minor but crucial elements when used in combination with other enabling technologies such as IoT and machine learning.” In one recent and very interesting customer case from the autonomous province of South Tyrol, Italy, blockchain was one of various cloud platform services required to make this scenario happen.

How to identify “blockchainable” processes and business topics (value drivers)

To understand the true value and impact of blockchain, we need to keep in mind that a verified transaction can involve any kind of digital asset such as cryptocurrency, contracts, and records (for instance, assets can be tangible equipment or digital media). While blockchain can be used for many different scenarios, some don’t need blockchain technology because they could be handled by a simple ledger, managed and owned by the company, or have such a large volume of data that a distributed ledger cannot support it. Blockchain would not the right solution for these scenarios.

Here are some common factors that can help identify potential blockchain use cases:

  • Multiparty collaboration: Are many different parties, and not just one, involved in the process or scenario, but one party dominates everything? For example, a company with many parties in the ecosystem that are all connected to it but not in a network or more decentralized structure.
  • Process optimization: Will blockchain massively improve a process that today is performed manually, involves multiple parties, needs to be digitized, and is very cumbersome to manage or be part of?
  • Transparency and auditability: Is it important to offer each party transparency (e.g., on the origin, delivery, geolocation, and hand-overs) and auditable steps? (e.g., How can I be sure that the wine in my bottle really is from Bordeaux?)
  • Risk and fraud minimization: Does it help (or is there a need) to minimize risk and fraud for each party, or at least for most of them in the chain? (e.g., A company might want to know if its goods have suffered any shocks in transit or whether the predefined route was not followed.)

Connecting blockchain with the Internet of Things

This is where blockchain’s value can be increased and automated. Just think about a blockchain that is not just maintained or simply added by a human, but automatically acquires different signals from sensors, such as geolocation, temperature, shock, usage hours, alerts, etc. One that knows when a payment or any kind of money transfer has been made, a delivery has been received or arrived at its destination, or a digital asset has been downloaded from the Internet. The relevant automated actions or signals are then recorded in the distributed ledger/blockchain.

Of course, given the massive amount of data that is created by those sensors, automated signals, and data streams, it is imperative that only the very few pieces of data coming from a signal that are relevant for a specific business process or transaction be stored in a blockchain. By recording non-relevant data in a blockchain, we would soon hit data size and performance issues.

Ideas to ignite thinking in specific industries

  • The digital, “blockchained” physical asset (asset lifecycle management): No matter whether you build, use, or maintain an asset, such as a machine, a piece of equipment, a turbine, or a whole aircraft, a blockchain transaction (genesis block) can be created when the asset is created. The blockchain will contain all the contracts and information for the asset as a whole and its parts. In this scenario, an entry is made in the blockchain every time an asset is: sold; maintained by the producer or owner’s maintenance team; audited by a third-party auditor; has malfunctioning parts; sends or receives information from sensors; meets specific thresholds; has spare parts built in; requires a change to the purpose or the capability of the assets due to age or usage duration; receives (or doesn’t receive) payments; etc.
  • The delivery chain, bill of lading: In today’s world, shipping freight from A to B involves lots of manual steps. For example, a carrier receives a booking from a shipper or forwarder, confirms it, and, before the document cut-off time, receives the shipping instructions describing the content and how the master bill of lading should be created. The carrier creates the original bill of lading and hands it over to the ordering party (the current owner of the cargo). Today, that original paper-based bill of lading is required for the freight (the container) to be picked up at the destination (the port of discharge). Imagine if we could do this as a blockchain transaction and by forwarding a PDF by email. There would be one transaction at the beginning, when the shipping carrier creates the bill of lading. Then there would be look-ups, e.g., by the import and release processing clerk of the shipper at the port of discharge and the new owner of the cargo at the destination. Then another transaction could document that the container had been handed over.

The future

I personally believe in the massive transformative power of blockchain, even though we are just at the very beginning. This transformation will be achieved by looking at larger networks with many participants that all have a nearly equal part in a process. Today, many blockchain ideas still have a more centralistic approach, in which one company has a more prominent role than the (many) others and often is “managing” this blockchain/distributed ledger-supported process/approach.

But think about the delivery scenario today, where goods are shipped from one door or company to another door or company, across many parties in the delivery chain: from the shipper/producer via the third-party logistics service provider and/or freight forwarder; to the companies doing the actual transport, like vessels, trucks, aircraft, trains, cars, ferries, and so on; to the final destination/receiver. And all of this happens across many countries, many borders, many handovers, customs, etc., and involves a lot of paperwork, across all constituents.

“Blockchaining” this will be truly transformational. But it will need all constituents in the process or network to participate, even if they have different interests, and to agree on basic principles and an approach.

As Torsten Zube put it, I am not a “blockchain extremist” nor a denier that believes this is just a hype, but a realist open to embracing a new technology in order to change our processes for our collective benefit.

Turn insight into action, make better decisions, and transform your business. Learn how.

Comments

Juergen Roehricht

About Juergen Roehricht

Juergen Roehricht is General Manager of Services Industries and Innovation Lead of the Middle and Eastern Europe region for SAP. The industries he covers include travel and transportation; professional services; media; and engineering, construction and operations. Besides managing the business in those segments, Juergen is focused on supporting innovation and digital transformation strategies of SAP customers. With more than 20 years of experience in IT, he stays up to date on the leading edge of innovation, pioneering and bringing new technologies to market and providing thought leadership. He has published several articles and books, including Collaborative Business and The Multi-Channel Company.