The God Graph – How EKGs and Systems Thinking Can Make the World Better

Originally posted on Medium by Dan McCreary. Follow him on LinkedIn.

Recent developments in distributed graph database technology have created a Cambrian Explosion in the capabilities of the world’s high-tech companies. Innovations that were once isolated to Bay Area companies like Google, Facebook, LinkedIn, and Twitter have migrated into commercial products like TigerGraph. These enterprise-scale graphs have enabled many companies to use these revolutionary technologies to provide integrated views of their customers and deep insights that save hundreds of millions of dollars a year.

However, making companies more efficient is not the only topic of interest to me. What is most striking is how these new integrated views of knowledge are changing the way we think. The new capabilities that Enterprise Knowlege Graphs have enabled are started to rewire our brains. They are triggering new connections in our brains that have never existed. They are a form of neurogenesis. And the patterns we are learning within the knowledge graph domain are being applied to other domains outside IT. This is the true revolution that is happening in organizations that are building enterprise knowledge graphs.

For the months of November and December, I will be not just focused on the technical aspects of the software and hardware behind enterprise knowledge graphs. I will include topics on how these technologies are forcing us to rethink our business strategy. I hope these articles can impact your IT strategies for 2021.

If you are not familiar with Systems Thinking, let me encourage you to find out more. Please follow my blogs to the end of the year. Systems Thinking is one of the key tools we use to seek out the root causes of problems and to understand how unintended consequences creep into our systems. Existential problems like the widespread extinction of millions of animal species and global warming are not a direct goal of our society. They are the unintended consequence of human population explosion, industrialization, and the burning of fossil fuels. Systems Thinking helps us build complex dependency graphs that can be used to explain what is happening in our IT systems and our society as a whole.

For those of you that are confused about the word “God” in the title of this article (and hopefully an upcoming book), let me explain. Some of you may have heard of the concept of a God Particle that was used to explain some of the forces in subatomic physics. It was a concept that tried to connect many physics theories together. I am also attempting something analogous. But I have a specific intent for using this term.

Primitive societies frequently associated God with a divine being cast in the representation of things they did understand: a human being. In polytheistic religions, these were many humans. But today, we are not constrained by mapping everything we value to a human image. I want to encourage everyone to think of a God Graph as a concept tied closely to sustainable progress for our civilization and the knowledge of all the interconnected systems we need to reach our goals. Our God Graph in this case is holistic Systems Thinking to help us understand how to minimize the unintended consequences to our planet. This is the big scale-out picture. My apologies if I offended anyone. That would be an unintended consequence.

My work with researchers at many companies like TigerGraph, Xilinx, Graphcore, Dell/EMC, and Intel has convinced me that we are just beginning to scratch the surface of what Enterprise Knowledge Graphs will become in the next few years. The cost-effective trillion vertex graph (called a teravertex graph) will be feasible for many organizations outside of Google and Facebook. They will become commodities. But the rules that govern them will be different. Research on scale laws in Complex Adaptive Systems predicts the rules will be different. But they can’t predict what the new rules will be. We can use knowledge of how the current 100 billion vertexes graphs are changing strategy to give us insights into what these rules will be.

Complex Adaptive Systems study scale laws. Every time our knowledge graphs grow an order of magnitude, new challenges, and opportunities arise. And we will see that Systems Graph Thinking applies to many levels of our IT strategy. At the organization level, we see many large organizations that are fragmented by business units and we see many department-level graph databases that focus on their short-term.

At the root cause of failure of many enterprise-level IT strategies is Conway’s Law: The idea that the systems we create in any organization are usually a reflection of our organization chart and may not be optimized to serve our customers or to achieve sustainable growth. It is the job of every CIO to recognize when isolated data silos are preventing efficiencies and enterprise insights. We will be looking at several case studies of how Conway’s Law and short-term thinking has resulted in negative unintended consequences for IT strategies.

Metcalf’s Law on the other hand is usually on the side of the value proposition for Enterprise Knowledge Graphs. Metcalf’s Law states that the value of any network tends to grow exponentially as the number of connections grows. This also applies to insights and discovery. The more systems we connect in our knowledge graph, the lower the cost of each new report, and the lower the cost for deep insight and knowledge discovery becomes.

Many of our readers come from highly decentralized organizations where today, they feel they have little hope of building enterprise knowledge graphs that create 50-millisecond access to 10,000 data points of every customer. We ask you to not lose faith in your ability to have a systemic impact on your organization. We hope to help you create smaller, kinder stepping stones to build a learning organization.

Ironically, I hope you will find that getting started at Systems Thinking is really not that complex. This is not about memorizing and learning how to apply hundreds of named patterns. From what I have learned so far, System Thinking relies on teaching people to look for a core set of patterns that repeat over and over again. We will look at concepts like graph visualization models (a lot like graph modeling), interconnectedness (lots of labeled edges), feedback loops, causality, synthesis, externalities, root cause analysis, resilience, and the evolutionary principles that change systems over time. We hope to use storytelling techniques to help you remember these ideas and make them easy to recognize in your work. We think that if you can retell these stories, convincing other non-technical decision-makers to build enterprise knowledge graphs will be easier.

I should note that I am not an expert on Systems Thinking or its more mathematical cousin, Complex Adaptive Systems Theory, which helps us simulate real-world systems in knowledge graphs. Yet I do have a great coach and mentor in Arun Batchu. Arun is the person that is constantly pushing me to take a more holistic view of enterprise IT strategy and see the “big picture” of trends in the industry. He is a true master in Systems Thinking. Everyone that wants to have an impact using Systems Thinking needs a coach like Arun.

I also want to thank people that have read my blogs and invited me to speak to other influencers. Getting feedback from people like Ellie Young and her Knowlege Graph Conference community has been one of the things that help motivate me to keep writing.

Originally posted on Medium by Dan McCreary. Follow him on LinkedIn.