Skip to content
START FOR FREE
START FOR FREE
  • SUPPORT
  • COMMUNITY
Menu
  • SUPPORT
  • COMMUNITY
MENUMENU
  • Products
    • The World’s Fastest and Most Scalable Graph Platform

      LEARN MORE

      Watch a TigerGraph Demo

      TIGERGRAPH CLOUD

      • Overview
      • TigerGraph Cloud Suite
      • FAQ
      • Pricing

      USER TOOLS

      • GraphStudio
      • Insights
      • Application Workbenches
      • Connectors and Drivers
      • Starter Kits
      • openCypher Support

      TIGERGRAPH DB

      • Overview
      • GSQL Query Language
      • Compare Editions

      GRAPH DATA SCIENCE

      • Graph Data Science Library
      • Machine Learning Workbench
  • Solutions
    • The World’s Fastest and Most Scalable Graph Platform

      LEARN MORE

      Watch a TigerGraph Demo

      Solutions

      • Solutions Overview

      INCREASE REVENUE

      • Customer Journey/360
      • Product Marketing
      • Entity Resolution
      • Recommendation Engine

      MANAGE RISK

      • Fraud Detection
      • Anti-Money Laundering
      • Threat Detection
      • Risk Monitoring

      IMPROVE OPERATIONS

      • Supply Chain Analysis
      • Energy Management
      • Network Optimization

      By Industry

      • Advertising, Media & Entertainment
      • Financial Services
      • Healthcare & Life Sciences

      FOUNDATIONAL

      • AI & Machine Learning
      • Time Series Analysis
      • Geospatial Analysis
  • Customers
    • The World’s Fastest and Most Scalable Graph Platform

      LEARN MORE

      CUSTOMER SUCCESS STORIES

      • Ford
      • Intuit
      • JPMorgan Chase
      • READ MORE SUCCESS STORIES
      • Jaguar Land Rover
      • United Health Group
      • Xbox
  • Partners
    • The World’s Fastest and Most Scalable Graph Platform

      LEARN MORE

      PARTNER PROGRAM

      • Partner Benefits
      • TigerGraph Partners
      • Sign Up
      TigerGraph partners with organizations that offer complementary technology solutions and services.​
  • Resources
    • The World’s Fastest and Most Scalable Graph Platform

      LEARN MORE

      BLOG

      • TigerGraph Blog

      RESOURCES

      • Resource Library
      • Benchmarks
      • Demos
      • O'Reilly Graph + ML Book

      EVENTS & WEBINARS

      • Graph+AI Summit
      • Graph for All - Million Dollar Challenge
      • Events &Trade Shows
      • Webinars

      DEVELOPERS

      • Documentation
      • Ecosystem
      • Developers Hub
      • Community Forum

      SUPPORT

      • Contact Support
      • Production Guidelines

      EDUCATION

      • Training & Certifications
  • Company
    • Join the World’s Fastest and Most Scalable Graph Platform

      WE ARE HIRING

      COMPANY

      • Company Overview
      • Leadership
      • Legal Terms
      • Patents
      • Security and Compliance

      CAREERS

      • Join Us
      • Open Positions

      AWARDS

      • Awards and Recognition
      • Leader in Forrester Wave
      • Gartner Research

      PRESS RELEASE

      • Read All Press Releases
      TigerGraph Recognized in 2022 Gartner® Critical Capabilities for Cloud Database Management Systems for Analytical Use Cases
      January 12, 2023
      Read More »

      NEWS

      • Read All News

      A Shock to the System: ShockNet Predicts How Economic Shocks Could Affect the World Economy

      TigerGraph Recognized for the First Time in the 2022 Gartner® Magic Quadrant™ for Cloud Database Management Systems

  • START FREE
    • The World’s Fastest and Most Scalable Graph Platform

      GET STARTED

      • Request a Demo
      • CONTACT US
      • Try TigerGraph
      • START FREE
      • TRY AN ONLINE DEMO

Evaluating Graph Solutions for Apache Spark

  • Songting Chen
  • October 17, 2019
  • blog, Developers
  • Blog >
  • Evaluating Graph Solutions for Apache Spark
Apache Spark is a popular general-purpose cluster-computing framework. An important addition to that framework is graph technology, which is rapidly growing in popularity as it proves its value across an increasing array of use cases. GraphX is Apache Spark’s API for graphs and graph-parallel computation. After being asked a few times to explain how GraphX compares to TigerGraph, I decided to implement a thorough evaluation of GraphX. This document presents the results of that assessment.

Comparing GraphX and TigerGraph 

GraphX, for those of you who may be unfamiliar with it, is a graph-processing framework that sits atop Apache Spark. In particular, it provides a Pregel API for implementing complex graph algorithms. Like Apache Spark, GraphX began as a research project at UC Berkeley’s AMPLab and Databricks, and was later donated to the Apache Software Foundation and the Spark project. We looked at four areas in our comparison of GraphX and TigerGraph, and I’ll review our findings here: 1. Graph data storage All data that is analyzed by GraphX are stored elsewhere and loaded on the fly for query. In comparison, TigerGraph manages an optimized graph data store where data can be preloaded by some ETL process and/or updated by real-time transactions. This is an important difference and means that, for analysis where data is to be loaded once and is static, GraphX is a better option (minimal initial cost; good for initial exploratory analysis) while, for analysis where data is loaded many times and may be dynamic, TigerGraph is a better option (some initial cost; good for repeated analysis). 2. Query expressiveness  We used the well-known PageRank algorithm as the basis for comparing the expressiveness of GraphX queries and GSQL queries (GSQL is TigerGraph’s SQL-procedure like query language).  Figure 1 and 2 depicts the PageRank query written in GraphX and TigerGraph respectively. One of the core components in PageRank algorithm is to compute the rank of each vertex from its neighbors. In GraphX, you need to define messages, and how the messages flow (e.g., from source to target vertex, or vice versa), and how to combine messages (highlighted in red in Figure 1), while in TigerGraph, you can declaratively define what you want to compute (also highlighted in red in Figure 2) and TigerGraph engine automatically figures out all the implementation / optimization details underneath.    Such declarative nature makes a lot easier to write complex algorithms. For example, in Figure 3, we can easily extend the original PageRank algorithm by adding one additional metrics (highlighted in red) that computes max rank among neighbors during the same computations. In GraphX, it will be up to users to figure out how to create / optimize messages among different computations. Besides graph algorithms, the other important aspect of graph analysis is pattern matching. GraphX’s sister project GraphFrame allows declarative pattern queries, and is a powerful enhancement when used in conjunction with GraphX. One example query is depicted in Figure 4.  In GSQL, user can write declarative queries that allow a mixture of both graph algorithms and pattern matching. Figure 5 depicts a simple recommendation algorithm. The statement highlighted in red in the figure is a pattern query that finds the users that bought the same products as the seed user. The rest of the query is an algorithm that further computes the ranked products from those users.  In summary, while both GraphX/GraphFrame and GSQL provide powerful graph analytics capabilities, it is easier to write complex algorithms using GSQL in general due to its declarative nature. 3. Supported workloads We evaluated GraphX in three areas to assess supported workloads: running a large query on a large dataset, real-time transactional updates such as inserting, updating and deleting vertices and/or edges, and support sub-second queries at high QPS (queries per second). 

Figure 6: Comparison of query workloads supported on GraphX and TigerGraph

In general, as Figure 6 shows, GraphX is designed for supporting OLAP workloads while TigerGraph supports hybrid transactional/analytical processing (HTAP). 4. Scalability and performance  Both GraphX and TigerGraph are horizontally scalable to handle very large data sets.  In this section, we compare their performance on two popular graph algorithms, namely, PageRank and Single Source Shortest Path. We used EdgePartition2D partition scheme for GraphX, which is the best partition strategy for these algorithms. The datasets we used is the popular Twitter dataset consisting of 41M vertices and 1.4B edges. Both GraphX and TigerGraph are running on 16 r5.2xlarge servers (8 cores, 64GB memory) on AWS. 

Figure 7: Performance comparison of TigerGraph and GraphX on PageRank 

Figure 7 depicts the performance of GraphX and TigerGraph on PageRank algorithm. I’d like to make three observations here: – The data loading and graph partition cost is non-trivial for GraphX. So if repeated analysis is necessary, it will be better to preload the data to a graph database such as TigerGraph. – GraphX requires quite a lot of memory to run compared to TigerGraph (15GB per server vs 0.8GB per server). – In terms of the algorithm execution time itself, TigerGraph is about twice as fast as GraphX. Figure 8 depicts the performance results on SSSP (single source shortest path) algorithm, where similar observations can be made. So here is a summary of our comparison of GraphX and TigerGraph: – GraphX’s strength is quick-to-result exploratory analysis that doesn’t require preloading the graph data. – TigerGraph’s strengths are high performance graph analytics, real time transactional updates and supporting high QPS sub-second query workloads.

Better Together: Spark and TigerGraph

Bringing native parallel graph speed and scalability in both OLTP and OLAP environments, TigerGraph and Spark integration allows machine learning to leverage the full power of graph data. Click here to learn more. There’s never been a better time to upgrade to TigerGraph – organizations such as Amgen, China Mobile, Intuit, Wish and Zillow that have already done so are gaining a competitive advantage. You can read reviews of our technology here.

You Might Also Like

TigerGraph Showcases Unrivaled Performance at Scale

TigerGraph Showcases Unrivaled Performance at Scale

January 12, 2023
How to Create a Visual Graph Analytics Application Using TigerGraph Insights in 30 mins

How to Create a Visual Graph...

November 14, 2022
Turbocharge your business intelligence with TigerGraph’s ML Workbench on TigerGraph Cloud

Turbocharge your business intelligence with TigerGraph’s...

November 14, 2022

Introducing TigerGraph 3.0

July 1, 2020

Everything to Know to Pass your TigerGraph Certification Test

June 24, 2020

Neo4j 4.0 Fabric – A Look Behind the Curtain

February 7, 2020

TigerGraph Blog

  • Categories
    • blogs
      • About TigerGraph
      • Benchmark
      • Business
      • Community
      • Compliance
      • Customer
      • Customer 360
      • Cybersecurity
      • Developers
      • Digital Twin
      • eCommerce
      • Emerging Use Cases
      • Entity Resolution
      • Finance
      • Fraud / Anti-Money Laundering
      • GQL
      • Graph Database Market
      • Graph Databases
      • GSQL
      • Healthcare
      • Machine Learning / AI
      • Podcast
      • Supply Chain
      • TigerGraph
      • TigerGraph Cloud
    • Graph AI On Demand
      • Analysts and Research
      • Customer 360 and Entity Resolution
      • Customer Spotlight
      • Development
      • Finance, Banking, Insurance
      • Keynote
      • Session
    • Video
  • Recent Posts

    • It’s Time to Harness the Power of Graph Technology [Infographic]
    • TigerGraph Showcases Unrivaled Performance at Scale
    • TigerGraph 101 An Introduction to Graph | Jan 26th @ 9am PST
    • Data Science Salon New York
    • Tech For Retail
    TigerGraph

    Product

    SOLUTIONS

    customers

    RESOURCES

    start for free

    TIGERGRAPH DB
    • Overview
    • Features
    • GSQL Query Language
    GRAPH DATA SCIENCE
    • Graph Data Science Library
    • Machine Learning Workbench
    TIGERGRAPH CLOUD
    • Overview
    • Cloud Starter Kits
    • Login
    • FAQ
    • Pricing
    • Cloud Marketplaces
    USEr TOOLS
    • GraphStudio
    • TigerGraph Insights
    • Application Workbenches
    • Connectors and Drivers
    • Starter Kits
    • openCypher Support
    SOLUTIONS
    • Why Graph?
    industry
    • Advertising, Media & Entertainment
    • Financial Services
    • Healthcare & Life Sciences
    use cases
    • Benefits
    • Product & Service Marketing
    • Entity Resolution
    • Customer 360/MDM
    • Recommendation Engine
    • Anti-Money Laundering
    • Cybersecurity Threat Detection
    • Fraud Detection
    • Risk Assessment & Monitoring
    • Energy Management
    • Network & IT Management
    • Supply Chain Analysis
    • AI & Machine Learning
    • Geospatial Analysis
    • Time Series Analysis
    success stories
    • Customer Success Stories

    Partners

    Partner program
    • Partner Benefits
    • TigerGraph Partners
    • Sign Up
    LIBRARY
    • Resources
    • Benchmark
    • Webinars
    Events
    • Trade Shows
    • Graph + AI Summit
    • Million Dollar Challenge
    EDUCATION
    • Training & Certifications
    Blog
    • TigerGraph Blog
    DEVELOPERS
    • Developers Hub
    • Community Forum
    • Documentation
    • Ecosystem

    COMPANY

    Company
    • Overview
    • Careers
    • News
    • Press Release
    • Awards
    • Legal
    • Patents
    • Security and Compliance
    • Contact
    Get Started
    • Start Free
    • Compare Editions
    • Online Demo - Test Drive
    • Request a Demo

    Product

    • Overview
    • TigerGraph 3.0
    • TIGERGRAPH DB
    • TIGERGRAPH CLOUD
    • GRAPHSTUDIO
    • TRY NOW

    customers

    • success stories

    RESOURCES

    • LIBRARY
    • Events
    • EDUCATION
    • BLOG
    • DEVELOPERS

    SOLUTIONS

    • SOLUTIONS
    • use cases
    • industry

    Partners

    • partner program

    company

    • Overview
    • news
    • Press Release
    • Awards

    start for free

    • Request Demo
    • take a test drive
    • SUPPORT
    • COMMUNITY
    • CONTACT
    • Copyright © 2023 TigerGraph
    • Privacy Policy
    • Linkedin
    • Facebook
    • Twitter

    Copyright © 2020 TigerGraph | Privacy Policy

    Copyright © 2020 TigerGraph Privacy Policy

    • SUPPORT
    • COMMUNITY
    • COMPANY
    • CONTACT
    • Linkedin
    • Facebook
    • Twitter

    Copyright © 2020 TigerGraph

    Privacy Policy

    • Products
    • Solutions
    • Customers
    • Partners
    • Resources
    • Company
    • START FREE
    START FOR FREE
    START FOR FREE
    TigerGraph
    PRODUCT
    PRODUCT
    • Overview
    • GraphStudio UI
    • Graph Data Science Library
    TIGERGRAPH DB
    • Overview
    • Features
    • GSQL Query Language
    TIGERGRAPH CLOUD
    • Overview
    • Cloud Starter Kits
    TRY TIGERGRAPH
    • Get Started for Free
    • Compare Editions
    SOLUTIONS
    SOLUTIONS
    • Why Graph?
    use cases
    • Benefits
    • Product & Service Marketing
    • Entity Resolution
    • Customer Journey/360
    • Recommendation Engine
    • Anti-Money Laundering (AML)
    • Cybersecurity Threat Detection
    • Fraud Detection
    • Risk Assessment & Monitoring
    • Energy Management
    • Network Resources Optimization
    • Supply Chain Analysis
    • AI & Machine Learning
    • Geospatial Analysis
    • Time Series Analysis
    industry
    • Advertising, Media & Entertainment
    • Financial Services
    • Healthcare & Life Sciences
    CUSTOMERS
    read all success stories

     

    PARTNERS
    Partner program
    • Partner Benefits
    • TigerGraph Partners
    • Sign Up
    RESOURCES
    LIBRARY
    • Resource Library
    • Benchmark
    • Webinars
    Events
    • Trade Shows
    • Graph + AI Summit
    • Graph for All - Million Dollar Challenge
    EDUCATION
    • TigerGraph Academy
    • Certification
    Blog
    • TigerGraph Blog
    DEVELOPERS
    • Developers Hub
    • Community Forum
    • Documentation
    • Ecosystem
    COMPANY
    COMPANY
    • Overview
    • Leadership
    • Careers  
    NEWS
    PRESS RELEASE
    AWARDS
    START FREE
    Start Free
    • Request a Demo
    • SUPPORT
    • COMMUNITY
    • CONTACT
    Dr. Jay Yu

    Dr. Jay Yu | VP of Product and Innovation

    Dr. Jay Yu is the VP of Product and Innovation at TigerGraph, responsible for driving product strategy and roadmap, as well as fostering innovation in graph database engine and graph solutions. He is a proven hands-on full-stack innovator, strategic thinker, leader, and evangelist for new technology and product, with 25+ years of industry experience ranging from highly scalable distributed database engine company (Teradata), B2B e-commerce services startup, to consumer-facing financial applications company (Intuit). He received his PhD from the University of Wisconsin - Madison, where he specialized in large scale parallel database systems

    Todd Blaschka | COO

    Todd Blaschka is a veteran in the enterprise software industry. He is passionate about creating entirely new segments in data, analytics and AI, with the distinction of establishing graph analytics as a Gartner Top 10 Data & Analytics trend two years in a row. By fervently focusing on critical industry and customer challenges, the companies under Todd's leadership have delivered significant quantifiable results to the largest brands in the world through channel and solution sales approach. Prior to TigerGraph, Todd led go to market and customer experience functions at Clustrix (acquired by MariaDB), Dataguise and IBM.