{"id":53974,"date":"2024-03-08T09:00:45","date_gmt":"2024-03-08T14:00:45","guid":{"rendered":"https:\/\/sdtimes.com\/?p=53974"},"modified":"2024-03-07T19:39:28","modified_gmt":"2024-03-08T00:39:28","slug":"sd-times-open-source-project-of-the-week-openhouse","status":"publish","type":"post","link":"https:\/\/sdtimes.com\/data\/sd-times-open-source-project-of-the-week-openhouse\/","title":{"rendered":"SD Times Open-Source Project of the Week: OpenHouse"},"content":{"rendered":"<p><span style=\"font-weight: 400;\">LinkedIn has announced it is open sourcing its control plane for managing tables in data lakehouse deployments.<\/span><\/p>\n<p><span style=\"font-weight: 400;\">The tool, called <\/span><a href=\"https:\/\/www.openhousedb.org\/\"><span style=\"font-weight: 400;\">OpenHouse<\/span><\/a><span style=\"font-weight: 400;\">, has been in use at LinkedIn for the past year. The company has 3,500 OpenHouse tables in production currently.\u00a0<\/span><\/p>\n<p><span style=\"font-weight: 400;\">It was designed to offer self-service management of tables in open data lakehouses. According to LinkedIn, it was running into challenges internally because it didn\u2019t have a good managed experience for running data lakehouses, which meant that end users were often dealing with low-level infrastructure concerns, which took time away from time they should have spent working on their products.<\/span><\/p>\n<p><span style=\"font-weight: 400;\">\u201cOverall, since rolling out OpenHouse, we\u2019ve seen drastic reduction in operational toil for data infra teams, improved developer experience for data infra customers, and enhanced governance for LinkedIn\u2019s data,\u201d Sumedh Sakdeo, senior staff software engineer at LinkedIn and creator of OpenHouse, wrote in a <\/span><a href=\"https:\/\/www.linkedin.com\/blog\/engineering\/open-source\/open-sourcing-openhouse\"><span style=\"font-weight: 400;\">blog post<\/span><\/a><span style=\"font-weight: 400;\">.\u00a0<\/span><\/p>\n<p><span style=\"font-weight: 400;\">OpenHouse consists of a declarative catalog and a suite of data services. The catalog includes definitions of tables, their schemas, and associated metadata, and it integrates with Apache Spark. It supports standard syntax such as SHOW DATABASE, SHOW TABLES, CREATE TABLE, ALTER TABLE, SELECT FROM, INSERT INTO, and DROP TABLE. The catalog is also where users can specify retention, replication, and sharing policies for the table.\u00a0<\/span><\/p>\n<p><span style=\"font-weight: 400;\">Another key element of OpenHouse is that it reconciles a table\u2019s observed state and its desired state, and this is where invoking data services comes in. Data services are responsible for orchestrating table maintenance jobs.\u00a0<\/span><\/p>\n<p><span style=\"font-weight: 400;\">According to LinkedIn, the goal was always to open source the project at some point, and therefore it was designed to provide pluggability with storage, authentication, authorization, database, and job submission services.\u00a0\u00a0<\/span><\/p>\n<p><span style=\"font-weight: 400;\">\u201cNow that we&#8217;ve reached the open sourcing milestone, we invite you to explore OpenHouse and provide us with your valuable feedback. We&#8217;re keen on collaborating with users to understand how OpenHouse performs within different environments, whether it&#8217;s integrated into cloud infrastructures or adapted to preferred table formats,\u201d Sakdeo wrote. <\/span><\/p>\n<!-- AddThis Advanced Settings generic via filter on the_content --><!-- AddThis Share Buttons generic via filter on the_content -->","protected":false},"excerpt":{"rendered":"<p>LinkedIn has announced it is open sourcing its control plane for managing tables in data lakehouse deployments. The tool, called OpenHouse, has been in use at LinkedIn for the past year. The company has 3,500 OpenHouse tables in production currently.\u00a0 It was designed to offer self-service management of tables in open data lakehouses. According to  &hellip; <a class=\"read-more\" href=\"https:\/\/sdtimes.com\/data\/sd-times-open-source-project-of-the-week-openhouse\/\">continue reading<\/a><!-- AddThis Advanced Settings generic via filter on get_the_excerpt --><!-- AddThis Share Buttons generic via filter on get_the_excerpt --><\/p>\n","protected":false},"author":752,"featured_media":53975,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"om_disable_all_campaigns":false,"cybocfi_hide_featured_image":"","footnotes":"","_links_to":"","_links_to_target":""},"categories":[1,15866],"tags":[2850,709,102,16894],"coauthors":[11687],"acf":[],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v23.8 - https:\/\/yoast.com\/wordpress\/plugins\/seo\/ -->\n<title>SD Times Open-Source Project of the Week: OpenHouse - SD Times<\/title>\n<meta name=\"description\" content=\"OpenHouse is a control plane for managing tables in data lakehouse deployments, developed by LinkedIn\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/sdtimes.com\/data\/sd-times-open-source-project-of-the-week-openhouse\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"SD Times Open-Source Project of the Week: OpenHouse - SD Times\" \/>\n<meta property=\"og:description\" content=\"OpenHouse is a control plane for managing tables in data lakehouse deployments, developed by LinkedIn\" \/>\n<meta property=\"og:url\" content=\"https:\/\/sdtimes.com\/data\/sd-times-open-source-project-of-the-week-openhouse\/\" \/>\n<meta property=\"og:site_name\" content=\"SD Times\" \/>\n<meta property=\"article:publisher\" content=\"https:\/\/www.facebook.com\/SDTimesD2\" \/>\n<meta property=\"article:published_time\" content=\"2024-03-08T14:00:45+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2024-03-08T00:39:28+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/sdtimes.com\/wp-content\/uploads\/2024\/03\/Screenshot-2024-03-07-at-7.39.04-PM.jpg\" \/>\n\t<meta property=\"og:image:width\" content=\"1032\" \/>\n\t<meta property=\"og:image:height\" content=\"654\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/jpeg\" \/>\n<meta name=\"author\" content=\"Jenna Barron\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:creator\" content=\"@sdtimes\" \/>\n<meta name=\"twitter:site\" content=\"@sdtimes\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Jenna Barron\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"2 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\/\/sdtimes.com\/data\/sd-times-open-source-project-of-the-week-openhouse\/#article\",\"isPartOf\":{\"@id\":\"https:\/\/sdtimes.com\/data\/sd-times-open-source-project-of-the-week-openhouse\/\"},\"author\":{\"name\":\"Jenna Barron\",\"@id\":\"https:\/\/sdtimes.com\/#\/schema\/person\/f2524e55ae19da07ea3613577da9f786\"},\"headline\":\"SD Times Open-Source Project of the Week: OpenHouse\",\"datePublished\":\"2024-03-08T14:00:45+00:00\",\"dateModified\":\"2024-03-08T00:39:28+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\/\/sdtimes.com\/data\/sd-times-open-source-project-of-the-week-openhouse\/\"},\"wordCount\":339,\"publisher\":{\"@id\":\"https:\/\/sdtimes.com\/#organization\"},\"image\":{\"@id\":\"https:\/\/sdtimes.com\/data\/sd-times-open-source-project-of-the-week-openhouse\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/sdtimes.com\/wp-content\/uploads\/2024\/03\/Screenshot-2024-03-07-at-7.39.04-PM.jpg\",\"keywords\":[\"data\",\"LinkedIn\",\"open source\",\"openhouse\"],\"articleSection\":[\"Latest News\",\"Open Source Project of the Week\"],\"inLanguage\":\"en-US\"},{\"@type\":\"WebPage\",\"@id\":\"https:\/\/sdtimes.com\/data\/sd-times-open-source-project-of-the-week-openhouse\/\",\"url\":\"https:\/\/sdtimes.com\/data\/sd-times-open-source-project-of-the-week-openhouse\/\",\"name\":\"SD Times Open-Source Project of the Week: OpenHouse - SD Times\",\"isPartOf\":{\"@id\":\"https:\/\/sdtimes.com\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\/\/sdtimes.com\/data\/sd-times-open-source-project-of-the-week-openhouse\/#primaryimage\"},\"image\":{\"@id\":\"https:\/\/sdtimes.com\/data\/sd-times-open-source-project-of-the-week-openhouse\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/sdtimes.com\/wp-content\/uploads\/2024\/03\/Screenshot-2024-03-07-at-7.39.04-PM.jpg\",\"datePublished\":\"2024-03-08T14:00:45+00:00\",\"dateModified\":\"2024-03-08T00:39:28+00:00\",\"description\":\"OpenHouse is a control plane for managing tables in data lakehouse deployments, developed by LinkedIn\",\"breadcrumb\":{\"@id\":\"https:\/\/sdtimes.com\/data\/sd-times-open-source-project-of-the-week-openhouse\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/sdtimes.com\/data\/sd-times-open-source-project-of-the-week-openhouse\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/sdtimes.com\/data\/sd-times-open-source-project-of-the-week-openhouse\/#primaryimage\",\"url\":\"https:\/\/sdtimes.com\/wp-content\/uploads\/2024\/03\/Screenshot-2024-03-07-at-7.39.04-PM.jpg\",\"contentUrl\":\"https:\/\/sdtimes.com\/wp-content\/uploads\/2024\/03\/Screenshot-2024-03-07-at-7.39.04-PM.jpg\",\"width\":1032,\"height\":654},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/sdtimes.com\/data\/sd-times-open-source-project-of-the-week-openhouse\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/sdtimes.com\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"SD Times Open-Source Project of the Week: OpenHouse\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/sdtimes.com\/#website\",\"url\":\"https:\/\/sdtimes.com\/\",\"name\":\"SD Times\",\"description\":\"Software Development News\",\"publisher\":{\"@id\":\"https:\/\/sdtimes.com\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/sdtimes.com\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Organization\",\"@id\":\"https:\/\/sdtimes.com\/#organization\",\"name\":\"SD Times\",\"url\":\"https:\/\/sdtimes.com\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/sdtimes.com\/#\/schema\/logo\/image\/\",\"url\":\"https:\/\/sdtimes.com\/wp-content\/uploads\/2014\/05\/deafaultlogo.png\",\"contentUrl\":\"https:\/\/sdtimes.com\/wp-content\/uploads\/2014\/05\/deafaultlogo.png\",\"width\":225,\"height\":90,\"caption\":\"SD Times\"},\"image\":{\"@id\":\"https:\/\/sdtimes.com\/#\/schema\/logo\/image\/\"},\"sameAs\":[\"https:\/\/www.facebook.com\/SDTimesD2\",\"https:\/\/x.com\/sdtimes\",\"https:\/\/www.linkedin.com\/company\/sdtimes\/\"]},{\"@type\":\"Person\",\"@id\":\"https:\/\/sdtimes.com\/#\/schema\/person\/f2524e55ae19da07ea3613577da9f786\",\"name\":\"Jenna Barron\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/sdtimes.com\/#\/schema\/person\/image\/b4be3423b187642936e62f121111345e\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/b128943929626cdcafccbac86bd306f9?s=96&d=mm&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/b128943929626cdcafccbac86bd306f9?s=96&d=mm&r=g\",\"caption\":\"Jenna Barron\"},\"description\":\"Jenna Barron is News Editor of SD Times.\",\"url\":\"https:\/\/sdtimes.com\/author\/jennifer-sargent\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"SD Times Open-Source Project of the Week: OpenHouse - SD Times","description":"OpenHouse is a control plane for managing tables in data lakehouse deployments, developed by LinkedIn","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/sdtimes.com\/data\/sd-times-open-source-project-of-the-week-openhouse\/","og_locale":"en_US","og_type":"article","og_title":"SD Times Open-Source Project of the Week: OpenHouse - SD Times","og_description":"OpenHouse is a control plane for managing tables in data lakehouse deployments, developed by LinkedIn","og_url":"https:\/\/sdtimes.com\/data\/sd-times-open-source-project-of-the-week-openhouse\/","og_site_name":"SD Times","article_publisher":"https:\/\/www.facebook.com\/SDTimesD2","article_published_time":"2024-03-08T14:00:45+00:00","article_modified_time":"2024-03-08T00:39:28+00:00","og_image":[{"width":1032,"height":654,"url":"https:\/\/sdtimes.com\/wp-content\/uploads\/2024\/03\/Screenshot-2024-03-07-at-7.39.04-PM.jpg","type":"image\/jpeg"}],"author":"Jenna Barron","twitter_card":"summary_large_image","twitter_creator":"@sdtimes","twitter_site":"@sdtimes","twitter_misc":{"Written by":"Jenna Barron","Est. reading time":"2 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/sdtimes.com\/data\/sd-times-open-source-project-of-the-week-openhouse\/#article","isPartOf":{"@id":"https:\/\/sdtimes.com\/data\/sd-times-open-source-project-of-the-week-openhouse\/"},"author":{"name":"Jenna Barron","@id":"https:\/\/sdtimes.com\/#\/schema\/person\/f2524e55ae19da07ea3613577da9f786"},"headline":"SD Times Open-Source Project of the Week: OpenHouse","datePublished":"2024-03-08T14:00:45+00:00","dateModified":"2024-03-08T00:39:28+00:00","mainEntityOfPage":{"@id":"https:\/\/sdtimes.com\/data\/sd-times-open-source-project-of-the-week-openhouse\/"},"wordCount":339,"publisher":{"@id":"https:\/\/sdtimes.com\/#organization"},"image":{"@id":"https:\/\/sdtimes.com\/data\/sd-times-open-source-project-of-the-week-openhouse\/#primaryimage"},"thumbnailUrl":"https:\/\/sdtimes.com\/wp-content\/uploads\/2024\/03\/Screenshot-2024-03-07-at-7.39.04-PM.jpg","keywords":["data","LinkedIn","open source","openhouse"],"articleSection":["Latest News","Open Source Project of the Week"],"inLanguage":"en-US"},{"@type":"WebPage","@id":"https:\/\/sdtimes.com\/data\/sd-times-open-source-project-of-the-week-openhouse\/","url":"https:\/\/sdtimes.com\/data\/sd-times-open-source-project-of-the-week-openhouse\/","name":"SD Times Open-Source Project of the Week: OpenHouse - SD Times","isPartOf":{"@id":"https:\/\/sdtimes.com\/#website"},"primaryImageOfPage":{"@id":"https:\/\/sdtimes.com\/data\/sd-times-open-source-project-of-the-week-openhouse\/#primaryimage"},"image":{"@id":"https:\/\/sdtimes.com\/data\/sd-times-open-source-project-of-the-week-openhouse\/#primaryimage"},"thumbnailUrl":"https:\/\/sdtimes.com\/wp-content\/uploads\/2024\/03\/Screenshot-2024-03-07-at-7.39.04-PM.jpg","datePublished":"2024-03-08T14:00:45+00:00","dateModified":"2024-03-08T00:39:28+00:00","description":"OpenHouse is a control plane for managing tables in data lakehouse deployments, developed by LinkedIn","breadcrumb":{"@id":"https:\/\/sdtimes.com\/data\/sd-times-open-source-project-of-the-week-openhouse\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/sdtimes.com\/data\/sd-times-open-source-project-of-the-week-openhouse\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/sdtimes.com\/data\/sd-times-open-source-project-of-the-week-openhouse\/#primaryimage","url":"https:\/\/sdtimes.com\/wp-content\/uploads\/2024\/03\/Screenshot-2024-03-07-at-7.39.04-PM.jpg","contentUrl":"https:\/\/sdtimes.com\/wp-content\/uploads\/2024\/03\/Screenshot-2024-03-07-at-7.39.04-PM.jpg","width":1032,"height":654},{"@type":"BreadcrumbList","@id":"https:\/\/sdtimes.com\/data\/sd-times-open-source-project-of-the-week-openhouse\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/sdtimes.com\/"},{"@type":"ListItem","position":2,"name":"SD Times Open-Source Project of the Week: OpenHouse"}]},{"@type":"WebSite","@id":"https:\/\/sdtimes.com\/#website","url":"https:\/\/sdtimes.com\/","name":"SD Times","description":"Software Development News","publisher":{"@id":"https:\/\/sdtimes.com\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/sdtimes.com\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/sdtimes.com\/#organization","name":"SD Times","url":"https:\/\/sdtimes.com\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/sdtimes.com\/#\/schema\/logo\/image\/","url":"https:\/\/sdtimes.com\/wp-content\/uploads\/2014\/05\/deafaultlogo.png","contentUrl":"https:\/\/sdtimes.com\/wp-content\/uploads\/2014\/05\/deafaultlogo.png","width":225,"height":90,"caption":"SD Times"},"image":{"@id":"https:\/\/sdtimes.com\/#\/schema\/logo\/image\/"},"sameAs":["https:\/\/www.facebook.com\/SDTimesD2","https:\/\/x.com\/sdtimes","https:\/\/www.linkedin.com\/company\/sdtimes\/"]},{"@type":"Person","@id":"https:\/\/sdtimes.com\/#\/schema\/person\/f2524e55ae19da07ea3613577da9f786","name":"Jenna Barron","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/sdtimes.com\/#\/schema\/person\/image\/b4be3423b187642936e62f121111345e","url":"https:\/\/secure.gravatar.com\/avatar\/b128943929626cdcafccbac86bd306f9?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/b128943929626cdcafccbac86bd306f9?s=96&d=mm&r=g","caption":"Jenna Barron"},"description":"Jenna Barron is News Editor of SD Times.","url":"https:\/\/sdtimes.com\/author\/jennifer-sargent\/"}]}},"_links":{"self":[{"href":"https:\/\/sdtimes.com\/wp-json\/wp\/v2\/posts\/53974"}],"collection":[{"href":"https:\/\/sdtimes.com\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/sdtimes.com\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/sdtimes.com\/wp-json\/wp\/v2\/users\/752"}],"replies":[{"embeddable":true,"href":"https:\/\/sdtimes.com\/wp-json\/wp\/v2\/comments?post=53974"}],"version-history":[{"count":1,"href":"https:\/\/sdtimes.com\/wp-json\/wp\/v2\/posts\/53974\/revisions"}],"predecessor-version":[{"id":53976,"href":"https:\/\/sdtimes.com\/wp-json\/wp\/v2\/posts\/53974\/revisions\/53976"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/sdtimes.com\/wp-json\/wp\/v2\/media\/53975"}],"wp:attachment":[{"href":"https:\/\/sdtimes.com\/wp-json\/wp\/v2\/media?parent=53974"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/sdtimes.com\/wp-json\/wp\/v2\/categories?post=53974"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/sdtimes.com\/wp-json\/wp\/v2\/tags?post=53974"},{"taxonomy":"author","embeddable":true,"href":"https:\/\/sdtimes.com\/wp-json\/wp\/v2\/coauthors?post=53974"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}