{"id":54763,"date":"2024-05-31T11:18:39","date_gmt":"2024-05-31T15:18:39","guid":{"rendered":"https:\/\/sdtimes.com\/?p=54763"},"modified":"2024-06-14T10:01:18","modified_gmt":"2024-06-14T14:01:18","slug":"sd-times-open-source-project-of-the-week-apache-pinot","status":"publish","type":"post","link":"https:\/\/sdtimes.com\/data\/sd-times-open-source-project-of-the-week-apache-pinot\/","title":{"rendered":"Apache Pinot – SD Times Open Source Project of the Week"},"content":{"rendered":"

Apache Pinot<\/a> is an open-source analytics platform that utilizes an OLAP database to provide low-latency insights into large amounts of data.<\/p>\n

OLAP stands for Online Analytical Processing and is a method in which data from multiple sources can be used together, allowing companies to group data from websites, applications, internal systems, and more together for analysis.<\/p>\n

\u201cFor example, a retailer stores data about all the products it sells, such as color, size, cost, and location. The retailer also collects customer purchase data, such as the name of the items ordered and total sales value, in a different system. OLAP combines the datasets to answer questions such as which color products are more popular or how product placement impacts sales,\u201d AWS wrote in a post<\/a> explaining OLAP.<\/p>\n

Key features of Apache Pinot include low-latency queries, the ability to handle hundreds of thousands of concurrent queries per second, batch and streaming ingestion, versatile joins, rich indexing options, and more.<\/p>\n

It was first created at LinkedIn in 2013 because the company wanted to provide its users interactive analytics, but with the amount of data LinkedIn had already amassed at that time, it was struggling to find something that could scale at the level it needed.<\/p>\n

\u201cPinot was born as an answer to our problems, a web-scale real-time analytics engine designed and built at LinkedIn. Pinot enables us to slice, dice and scan through massively large quantities of data in real-time across a wide variety of products,\u201d said Praveen Neppalli Naga, engineering manager at LinkedIn at the time, wrote in a blog post<\/a> when the project was first announced.<\/p>\n

It powers<\/a> 25 of LinkedIn\u2019s user-facing features such as Who Viewed My Profile, Company Follow Analytics, Jobs Analytics, and more, as well as over 30 of the company\u2019s internal tools, such as its A\/B testing platform.<\/p>\n

In 2018<\/a>, Apache Pinot joined the Apache Software Foundation as an incubator project and became a top-level project in 2021.<\/p>\n

Since its creation it has been adopted by a number of major companies, including Robinhood, Slack, Stripe, Target, Uber, and Walmart.<\/p>\n

The most recent release is 1.1, which came out in March, adding features<\/a> such as vector index support and multi-stage query engine improvements.<\/p>\n

Looking forward, some of the things the project maintainers are working on in 2024<\/a> include making V2 on-by-default, enabling column null storing by default, full PostgreSQL compliance, pagination, and continuing ease-of-use updates such as improved documentation, more user friendly error messages, and more.<\/p>\n","protected":false},"excerpt":{"rendered":"

Apache Pinot is an open-source analytics platform that utilizes an OLAP database to provide low-latency insights into large amounts of data. OLAP stands for Online Analytical Processing and is a method in which data from multiple sources can be used together, allowing companies to group data from websites, applications, internal systems, and more together for … continue reading<\/a><\/p>\n","protected":false},"author":752,"featured_media":54764,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"om_disable_all_campaigns":false,"cybocfi_hide_featured_image":"","footnotes":"","_links_to":"","_links_to_target":""},"categories":[1,15866],"tags":[16972,2850,709],"coauthors":[11687],"acf":[],"yoast_head":"\nApache Pinot - SD Times Open Source Project of the Week - SD Times<\/title>\n<meta name=\"description\" content=\"Apache Pinot is an open-source analytics platform that utilizes an OLAP database to provide low-latency insights into large amounts of data.\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/sdtimes.com\/data\/sd-times-open-source-project-of-the-week-apache-pinot\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Apache Pinot - SD Times Open Source Project of the Week - SD Times\" \/>\n<meta property=\"og:description\" content=\"Apache Pinot is an open-source analytics platform that utilizes an OLAP database to provide low-latency insights into large amounts of data.\" \/>\n<meta property=\"og:url\" content=\"https:\/\/sdtimes.com\/data\/sd-times-open-source-project-of-the-week-apache-pinot\/\" \/>\n<meta property=\"og:site_name\" content=\"SD Times\" \/>\n<meta property=\"article:publisher\" content=\"https:\/\/www.facebook.com\/SDTimesD2\" \/>\n<meta property=\"article:published_time\" content=\"2024-05-31T15:18:39+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2024-06-14T14:01:18+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/sdtimes.com\/wp-content\/uploads\/2024\/05\/206d1d5f370fe007339994d57c855a7e.png\" \/>\n\t<meta property=\"og:image:width\" content=\"1192\" \/>\n\t<meta property=\"og:image:height\" content=\"475\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/png\" \/>\n<meta name=\"author\" content=\"Jenna Barron\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:creator\" content=\"@sdtimes\" \/>\n<meta name=\"twitter:site\" content=\"@sdtimes\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Jenna Barron\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"2 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\/\/sdtimes.com\/data\/sd-times-open-source-project-of-the-week-apache-pinot\/#article\",\"isPartOf\":{\"@id\":\"https:\/\/sdtimes.com\/data\/sd-times-open-source-project-of-the-week-apache-pinot\/\"},\"author\":{\"name\":\"Jenna Barron\",\"@id\":\"https:\/\/sdtimes.com\/#\/schema\/person\/f2524e55ae19da07ea3613577da9f786\"},\"headline\":\"Apache Pinot – SD Times Open Source Project of the Week\",\"datePublished\":\"2024-05-31T15:18:39+00:00\",\"dateModified\":\"2024-06-14T14:01:18+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\/\/sdtimes.com\/data\/sd-times-open-source-project-of-the-week-apache-pinot\/\"},\"wordCount\":415,\"publisher\":{\"@id\":\"https:\/\/sdtimes.com\/#organization\"},\"image\":{\"@id\":\"https:\/\/sdtimes.com\/data\/sd-times-open-source-project-of-the-week-apache-pinot\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/sdtimes.com\/wp-content\/uploads\/2024\/05\/206d1d5f370fe007339994d57c855a7e.png\",\"keywords\":[\"apache pinot\",\"data\",\"LinkedIn\"],\"articleSection\":[\"Latest News\",\"Open Source Project of the Week\"],\"inLanguage\":\"en-US\"},{\"@type\":\"WebPage\",\"@id\":\"https:\/\/sdtimes.com\/data\/sd-times-open-source-project-of-the-week-apache-pinot\/\",\"url\":\"https:\/\/sdtimes.com\/data\/sd-times-open-source-project-of-the-week-apache-pinot\/\",\"name\":\"Apache Pinot - SD Times Open Source Project of the Week - SD Times\",\"isPartOf\":{\"@id\":\"https:\/\/sdtimes.com\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\/\/sdtimes.com\/data\/sd-times-open-source-project-of-the-week-apache-pinot\/#primaryimage\"},\"image\":{\"@id\":\"https:\/\/sdtimes.com\/data\/sd-times-open-source-project-of-the-week-apache-pinot\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/sdtimes.com\/wp-content\/uploads\/2024\/05\/206d1d5f370fe007339994d57c855a7e.png\",\"datePublished\":\"2024-05-31T15:18:39+00:00\",\"dateModified\":\"2024-06-14T14:01:18+00:00\",\"description\":\"Apache Pinot is an open-source analytics platform that utilizes an OLAP database to provide low-latency insights into large amounts of data.\",\"breadcrumb\":{\"@id\":\"https:\/\/sdtimes.com\/data\/sd-times-open-source-project-of-the-week-apache-pinot\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/sdtimes.com\/data\/sd-times-open-source-project-of-the-week-apache-pinot\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/sdtimes.com\/data\/sd-times-open-source-project-of-the-week-apache-pinot\/#primaryimage\",\"url\":\"https:\/\/sdtimes.com\/wp-content\/uploads\/2024\/05\/206d1d5f370fe007339994d57c855a7e.png\",\"contentUrl\":\"https:\/\/sdtimes.com\/wp-content\/uploads\/2024\/05\/206d1d5f370fe007339994d57c855a7e.png\",\"width\":1192,\"height\":475},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/sdtimes.com\/data\/sd-times-open-source-project-of-the-week-apache-pinot\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/sdtimes.com\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Apache Pinot – SD Times Open Source Project of the Week\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/sdtimes.com\/#website\",\"url\":\"https:\/\/sdtimes.com\/\",\"name\":\"SD Times\",\"description\":\"Software Development News\",\"publisher\":{\"@id\":\"https:\/\/sdtimes.com\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/sdtimes.com\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Organization\",\"@id\":\"https:\/\/sdtimes.com\/#organization\",\"name\":\"SD Times\",\"url\":\"https:\/\/sdtimes.com\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/sdtimes.com\/#\/schema\/logo\/image\/\",\"url\":\"https:\/\/sdtimes.com\/wp-content\/uploads\/2014\/05\/deafaultlogo.png\",\"contentUrl\":\"https:\/\/sdtimes.com\/wp-content\/uploads\/2014\/05\/deafaultlogo.png\",\"width\":225,\"height\":90,\"caption\":\"SD Times\"},\"image\":{\"@id\":\"https:\/\/sdtimes.com\/#\/schema\/logo\/image\/\"},\"sameAs\":[\"https:\/\/www.facebook.com\/SDTimesD2\",\"https:\/\/x.com\/sdtimes\",\"https:\/\/www.linkedin.com\/company\/sdtimes\/\"]},{\"@type\":\"Person\",\"@id\":\"https:\/\/sdtimes.com\/#\/schema\/person\/f2524e55ae19da07ea3613577da9f786\",\"name\":\"Jenna Barron\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/sdtimes.com\/#\/schema\/person\/image\/b4be3423b187642936e62f121111345e\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/b128943929626cdcafccbac86bd306f9?s=96&d=mm&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/b128943929626cdcafccbac86bd306f9?s=96&d=mm&r=g\",\"caption\":\"Jenna Barron\"},\"description\":\"Jenna Barron is News Editor of SD Times.\",\"url\":\"https:\/\/sdtimes.com\/author\/jennifer-sargent\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Apache Pinot - SD Times Open Source Project of the Week - SD Times","description":"Apache Pinot is an open-source analytics platform that utilizes an OLAP database to provide low-latency insights into large amounts of data.","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/sdtimes.com\/data\/sd-times-open-source-project-of-the-week-apache-pinot\/","og_locale":"en_US","og_type":"article","og_title":"Apache Pinot - SD Times Open Source Project of the Week - SD Times","og_description":"Apache Pinot is an open-source analytics platform that utilizes an OLAP database to provide low-latency insights into large amounts of data.","og_url":"https:\/\/sdtimes.com\/data\/sd-times-open-source-project-of-the-week-apache-pinot\/","og_site_name":"SD Times","article_publisher":"https:\/\/www.facebook.com\/SDTimesD2","article_published_time":"2024-05-31T15:18:39+00:00","article_modified_time":"2024-06-14T14:01:18+00:00","og_image":[{"width":1192,"height":475,"url":"https:\/\/sdtimes.com\/wp-content\/uploads\/2024\/05\/206d1d5f370fe007339994d57c855a7e.png","type":"image\/png"}],"author":"Jenna Barron","twitter_card":"summary_large_image","twitter_creator":"@sdtimes","twitter_site":"@sdtimes","twitter_misc":{"Written by":"Jenna Barron","Est. reading time":"2 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/sdtimes.com\/data\/sd-times-open-source-project-of-the-week-apache-pinot\/#article","isPartOf":{"@id":"https:\/\/sdtimes.com\/data\/sd-times-open-source-project-of-the-week-apache-pinot\/"},"author":{"name":"Jenna Barron","@id":"https:\/\/sdtimes.com\/#\/schema\/person\/f2524e55ae19da07ea3613577da9f786"},"headline":"Apache Pinot – SD Times Open Source Project of the Week","datePublished":"2024-05-31T15:18:39+00:00","dateModified":"2024-06-14T14:01:18+00:00","mainEntityOfPage":{"@id":"https:\/\/sdtimes.com\/data\/sd-times-open-source-project-of-the-week-apache-pinot\/"},"wordCount":415,"publisher":{"@id":"https:\/\/sdtimes.com\/#organization"},"image":{"@id":"https:\/\/sdtimes.com\/data\/sd-times-open-source-project-of-the-week-apache-pinot\/#primaryimage"},"thumbnailUrl":"https:\/\/sdtimes.com\/wp-content\/uploads\/2024\/05\/206d1d5f370fe007339994d57c855a7e.png","keywords":["apache pinot","data","LinkedIn"],"articleSection":["Latest News","Open Source Project of the Week"],"inLanguage":"en-US"},{"@type":"WebPage","@id":"https:\/\/sdtimes.com\/data\/sd-times-open-source-project-of-the-week-apache-pinot\/","url":"https:\/\/sdtimes.com\/data\/sd-times-open-source-project-of-the-week-apache-pinot\/","name":"Apache Pinot - SD Times Open Source Project of the Week - SD Times","isPartOf":{"@id":"https:\/\/sdtimes.com\/#website"},"primaryImageOfPage":{"@id":"https:\/\/sdtimes.com\/data\/sd-times-open-source-project-of-the-week-apache-pinot\/#primaryimage"},"image":{"@id":"https:\/\/sdtimes.com\/data\/sd-times-open-source-project-of-the-week-apache-pinot\/#primaryimage"},"thumbnailUrl":"https:\/\/sdtimes.com\/wp-content\/uploads\/2024\/05\/206d1d5f370fe007339994d57c855a7e.png","datePublished":"2024-05-31T15:18:39+00:00","dateModified":"2024-06-14T14:01:18+00:00","description":"Apache Pinot is an open-source analytics platform that utilizes an OLAP database to provide low-latency insights into large amounts of data.","breadcrumb":{"@id":"https:\/\/sdtimes.com\/data\/sd-times-open-source-project-of-the-week-apache-pinot\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/sdtimes.com\/data\/sd-times-open-source-project-of-the-week-apache-pinot\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/sdtimes.com\/data\/sd-times-open-source-project-of-the-week-apache-pinot\/#primaryimage","url":"https:\/\/sdtimes.com\/wp-content\/uploads\/2024\/05\/206d1d5f370fe007339994d57c855a7e.png","contentUrl":"https:\/\/sdtimes.com\/wp-content\/uploads\/2024\/05\/206d1d5f370fe007339994d57c855a7e.png","width":1192,"height":475},{"@type":"BreadcrumbList","@id":"https:\/\/sdtimes.com\/data\/sd-times-open-source-project-of-the-week-apache-pinot\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/sdtimes.com\/"},{"@type":"ListItem","position":2,"name":"Apache Pinot – SD Times Open Source Project of the Week"}]},{"@type":"WebSite","@id":"https:\/\/sdtimes.com\/#website","url":"https:\/\/sdtimes.com\/","name":"SD Times","description":"Software Development News","publisher":{"@id":"https:\/\/sdtimes.com\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/sdtimes.com\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/sdtimes.com\/#organization","name":"SD Times","url":"https:\/\/sdtimes.com\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/sdtimes.com\/#\/schema\/logo\/image\/","url":"https:\/\/sdtimes.com\/wp-content\/uploads\/2014\/05\/deafaultlogo.png","contentUrl":"https:\/\/sdtimes.com\/wp-content\/uploads\/2014\/05\/deafaultlogo.png","width":225,"height":90,"caption":"SD Times"},"image":{"@id":"https:\/\/sdtimes.com\/#\/schema\/logo\/image\/"},"sameAs":["https:\/\/www.facebook.com\/SDTimesD2","https:\/\/x.com\/sdtimes","https:\/\/www.linkedin.com\/company\/sdtimes\/"]},{"@type":"Person","@id":"https:\/\/sdtimes.com\/#\/schema\/person\/f2524e55ae19da07ea3613577da9f786","name":"Jenna Barron","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/sdtimes.com\/#\/schema\/person\/image\/b4be3423b187642936e62f121111345e","url":"https:\/\/secure.gravatar.com\/avatar\/b128943929626cdcafccbac86bd306f9?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/b128943929626cdcafccbac86bd306f9?s=96&d=mm&r=g","caption":"Jenna Barron"},"description":"Jenna Barron is News Editor of SD Times.","url":"https:\/\/sdtimes.com\/author\/jennifer-sargent\/"}]}},"_links":{"self":[{"href":"https:\/\/sdtimes.com\/wp-json\/wp\/v2\/posts\/54763"}],"collection":[{"href":"https:\/\/sdtimes.com\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/sdtimes.com\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/sdtimes.com\/wp-json\/wp\/v2\/users\/752"}],"replies":[{"embeddable":true,"href":"https:\/\/sdtimes.com\/wp-json\/wp\/v2\/comments?post=54763"}],"version-history":[{"count":4,"href":"https:\/\/sdtimes.com\/wp-json\/wp\/v2\/posts\/54763\/revisions"}],"predecessor-version":[{"id":54768,"href":"https:\/\/sdtimes.com\/wp-json\/wp\/v2\/posts\/54763\/revisions\/54768"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/sdtimes.com\/wp-json\/wp\/v2\/media\/54764"}],"wp:attachment":[{"href":"https:\/\/sdtimes.com\/wp-json\/wp\/v2\/media?parent=54763"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/sdtimes.com\/wp-json\/wp\/v2\/categories?post=54763"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/sdtimes.com\/wp-json\/wp\/v2\/tags?post=54763"},{"taxonomy":"author","embeddable":true,"href":"https:\/\/sdtimes.com\/wp-json\/wp\/v2\/coauthors?post=54763"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}