{"id":55540,"date":"2024-08-27T10:57:32","date_gmt":"2024-08-27T14:57:32","guid":{"rendered":"https:\/\/sdtimes.com\/?p=55540"},"modified":"2024-08-27T14:08:22","modified_gmt":"2024-08-27T18:08:22","slug":"pinecone-previews-new-bulk-import-feature-for-its-serverless-offering","status":"publish","type":"post","link":"https:\/\/sdtimes.com\/data\/pinecone-previews-new-bulk-import-feature-for-its-serverless-offering\/","title":{"rendered":"Pinecone previews new bulk import feature for its serverless offering"},"content":{"rendered":"<p><a href=\"https:\/\/www.pinecone.io\/\"><span style=\"font-weight: 400;\">Pinecone<\/span><\/a><span style=\"font-weight: 400;\">, a vector database for scaling AI, is introducing a new bulk import feature to make it easier to ingest large amounts of data into its serverless infrastructure.\u00a0<\/span><\/p>\n<p><span style=\"font-weight: 400;\">According to the company, this new feature, now in early access, is useful in scenarios when a team would want to import over 100 million records (though it currently has a 200 million record limit), onboard a known or new tenant, or migrate production workloads from another provider into Pinecone.\u00a0<\/span><\/p>\n<p><span style=\"font-weight: 400;\">The company claims that bulk import results in six times lower ingestion costs than comparable upsert-based processes. It costs $1.00\/GB, and, for instance, ingesting 10 million records of 768-dimension costs $30 with bulk import.\u00a0<\/span><\/p>\n<p><strong>RELATED: <a href=\"https:\/\/sdtimes.com\/ai\/pros-and-cons-of-5-ai-ml-workflow-tools-for-data-scientists-today\/\">Pros and cons of 5 AI\/ML workflow tools for data scientists today<\/a><\/strong><\/p>\n<p><span style=\"font-weight: 400;\">Because it is an asynchronous, long-running process, customers don\u2019t have to performance tune or monitor the status of their imports; Pinecone takes care of it in the background.\u00a0<\/span><\/p>\n<p><span style=\"font-weight: 400;\">During the import process, data is read from a secure bucket in the customer\u2019s object storage, which provides them with control over data access, including the ability to revoke Pinecone\u2019s access whenever.\u00a0<\/span><\/p>\n<p><span style=\"font-weight: 400;\">While in early access, Pinecone is limiting bulk import to writing records into a new serverless namespace, meaning that data cannot currently be imported into existing namespaces. Additionally, bulk import is limited to Amazon S3 for serverless AWS regions, but the company will be adding support for Google Cloud Storage and Azure Blob Storage in a couple of weeks.<\/span><\/p>\n<h5><b>Pinecone serverless now GA on Google Cloud, Microsoft Azure<\/b><\/h5>\n<p><span style=\"font-weight: 400;\">Adding to the existing AWS support, Pinecone serverless is now generally available on both Google Cloud and Microsoft Azure.<\/span><\/p>\n<p><span style=\"font-weight: 400;\">Google Cloud support is available in us-central1 (Iowa) and europe-west4 (Netherlands), and Microsoft Azure support is available in eastus2 (Virginia), with additional regions coming soon to both clouds.\u00a0\u00a0<\/span><\/p>\n<p><span style=\"font-weight: 400;\">This availability also comes with new features in early access, such as backups for serverless indexes for all three clouds available for Standard and Enterprise users, and more granular access controls for the Control Plane and Data Plane, including NoAccess, ReadOnly, and ReadWrite. Pinecone will also add more user roles \u2014 Org Owner, Billing Admin, Org Manager, and Org Member \u2014 at the Organization and Project levels in a couple of weeks.\u00a0<\/span><\/p>\n<p><span style=\"font-weight: 400;\">\u201cBringing Pinecone\u2019s serverless vector database to Google Cloud Marketplace will help <\/span><span style=\"font-weight: 400;\">customers quickly deploy, manage, and grow the platform on Google Cloud\u2019s trusted, global infrastructure,\u201d said Dai Vu, managing director of Marketplace &amp; ISV GTM Programs at Google Cloud. \u201cPinecone customers can now easily build knowledgeable AI applications securely and at scale as they progress their digital transformation journeys.\u201d<\/span><\/p>\n<!-- AddThis Advanced Settings generic via filter on the_content --><!-- AddThis Share Buttons generic via filter on the_content -->","protected":false},"excerpt":{"rendered":"<p>Pinecone, a vector database for scaling AI, is introducing a new bulk import feature to make it easier to ingest large amounts of data into its serverless infrastructure.\u00a0 According to the company, this new feature, now in early access, is useful in scenarios when a team would want to import over 100 million records (though  &hellip; <a class=\"read-more\" href=\"https:\/\/sdtimes.com\/data\/pinecone-previews-new-bulk-import-feature-for-its-serverless-offering\/\">continue reading<\/a><!-- AddThis Advanced Settings generic via filter on get_the_excerpt --><!-- AddThis Share Buttons generic via filter on get_the_excerpt --><\/p>\n","protected":false},"author":752,"featured_media":55541,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"om_disable_all_campaigns":false,"cybocfi_hide_featured_image":"","footnotes":"","_links_to":"","_links_to_target":""},"categories":[1],"tags":[2850,15562],"coauthors":[11687],"acf":[],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v23.8 - https:\/\/yoast.com\/wordpress\/plugins\/seo\/ -->\n<title>Pinecone previews new bulk import feature for its serverless offering - SD Times<\/title>\n<meta name=\"description\" content=\"The new bulk import feature makes it easier to ingest large amounts of data into Pinecone&#039;s serverless infrastructure.\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/sdtimes.com\/data\/pinecone-previews-new-bulk-import-feature-for-its-serverless-offering\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Pinecone previews new bulk import feature for its serverless offering - SD Times\" \/>\n<meta property=\"og:description\" content=\"The new bulk import feature makes it easier to ingest large amounts of data into Pinecone&#039;s serverless infrastructure.\" \/>\n<meta property=\"og:url\" content=\"https:\/\/sdtimes.com\/data\/pinecone-previews-new-bulk-import-feature-for-its-serverless-offering\/\" \/>\n<meta property=\"og:site_name\" content=\"SD Times\" \/>\n<meta property=\"article:publisher\" content=\"https:\/\/www.facebook.com\/SDTimesD2\" \/>\n<meta property=\"article:published_time\" content=\"2024-08-27T14:57:32+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2024-08-27T18:08:22+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/sdtimes.com\/wp-content\/uploads\/2024\/08\/port-1845350_1280.jpg\" \/>\n\t<meta property=\"og:image:width\" content=\"1280\" \/>\n\t<meta property=\"og:image:height\" content=\"853\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/jpeg\" \/>\n<meta name=\"author\" content=\"Jenna Barron\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:creator\" content=\"@sdtimes\" \/>\n<meta name=\"twitter:site\" content=\"@sdtimes\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Jenna Barron\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"3 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\/\/sdtimes.com\/data\/pinecone-previews-new-bulk-import-feature-for-its-serverless-offering\/#article\",\"isPartOf\":{\"@id\":\"https:\/\/sdtimes.com\/data\/pinecone-previews-new-bulk-import-feature-for-its-serverless-offering\/\"},\"author\":{\"name\":\"Jenna Barron\",\"@id\":\"https:\/\/sdtimes.com\/#\/schema\/person\/f2524e55ae19da07ea3613577da9f786\"},\"headline\":\"Pinecone previews new bulk import feature for its serverless offering\",\"datePublished\":\"2024-08-27T14:57:32+00:00\",\"dateModified\":\"2024-08-27T18:08:22+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\/\/sdtimes.com\/data\/pinecone-previews-new-bulk-import-feature-for-its-serverless-offering\/\"},\"wordCount\":440,\"publisher\":{\"@id\":\"https:\/\/sdtimes.com\/#organization\"},\"image\":{\"@id\":\"https:\/\/sdtimes.com\/data\/pinecone-previews-new-bulk-import-feature-for-its-serverless-offering\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/sdtimes.com\/wp-content\/uploads\/2024\/08\/port-1845350_1280.jpg\",\"keywords\":[\"data\",\"Pinecone\"],\"articleSection\":[\"Latest News\"],\"inLanguage\":\"en-US\"},{\"@type\":\"WebPage\",\"@id\":\"https:\/\/sdtimes.com\/data\/pinecone-previews-new-bulk-import-feature-for-its-serverless-offering\/\",\"url\":\"https:\/\/sdtimes.com\/data\/pinecone-previews-new-bulk-import-feature-for-its-serverless-offering\/\",\"name\":\"Pinecone previews new bulk import feature for its serverless offering - SD Times\",\"isPartOf\":{\"@id\":\"https:\/\/sdtimes.com\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\/\/sdtimes.com\/data\/pinecone-previews-new-bulk-import-feature-for-its-serverless-offering\/#primaryimage\"},\"image\":{\"@id\":\"https:\/\/sdtimes.com\/data\/pinecone-previews-new-bulk-import-feature-for-its-serverless-offering\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/sdtimes.com\/wp-content\/uploads\/2024\/08\/port-1845350_1280.jpg\",\"datePublished\":\"2024-08-27T14:57:32+00:00\",\"dateModified\":\"2024-08-27T18:08:22+00:00\",\"description\":\"The new bulk import feature makes it easier to ingest large amounts of data into Pinecone's serverless infrastructure.\",\"breadcrumb\":{\"@id\":\"https:\/\/sdtimes.com\/data\/pinecone-previews-new-bulk-import-feature-for-its-serverless-offering\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/sdtimes.com\/data\/pinecone-previews-new-bulk-import-feature-for-its-serverless-offering\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/sdtimes.com\/data\/pinecone-previews-new-bulk-import-feature-for-its-serverless-offering\/#primaryimage\",\"url\":\"https:\/\/sdtimes.com\/wp-content\/uploads\/2024\/08\/port-1845350_1280.jpg\",\"contentUrl\":\"https:\/\/sdtimes.com\/wp-content\/uploads\/2024\/08\/port-1845350_1280.jpg\",\"width\":1280,\"height\":853},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/sdtimes.com\/data\/pinecone-previews-new-bulk-import-feature-for-its-serverless-offering\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/sdtimes.com\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Pinecone previews new bulk import feature for its serverless offering\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/sdtimes.com\/#website\",\"url\":\"https:\/\/sdtimes.com\/\",\"name\":\"SD Times\",\"description\":\"Software Development News\",\"publisher\":{\"@id\":\"https:\/\/sdtimes.com\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/sdtimes.com\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Organization\",\"@id\":\"https:\/\/sdtimes.com\/#organization\",\"name\":\"SD Times\",\"url\":\"https:\/\/sdtimes.com\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/sdtimes.com\/#\/schema\/logo\/image\/\",\"url\":\"https:\/\/sdtimes.com\/wp-content\/uploads\/2014\/05\/deafaultlogo.png\",\"contentUrl\":\"https:\/\/sdtimes.com\/wp-content\/uploads\/2014\/05\/deafaultlogo.png\",\"width\":225,\"height\":90,\"caption\":\"SD Times\"},\"image\":{\"@id\":\"https:\/\/sdtimes.com\/#\/schema\/logo\/image\/\"},\"sameAs\":[\"https:\/\/www.facebook.com\/SDTimesD2\",\"https:\/\/x.com\/sdtimes\",\"https:\/\/www.linkedin.com\/company\/sdtimes\/\"]},{\"@type\":\"Person\",\"@id\":\"https:\/\/sdtimes.com\/#\/schema\/person\/f2524e55ae19da07ea3613577da9f786\",\"name\":\"Jenna Barron\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/sdtimes.com\/#\/schema\/person\/image\/b4be3423b187642936e62f121111345e\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/b128943929626cdcafccbac86bd306f9?s=96&d=mm&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/b128943929626cdcafccbac86bd306f9?s=96&d=mm&r=g\",\"caption\":\"Jenna Barron\"},\"description\":\"Jenna Barron is News Editor of SD Times.\",\"url\":\"https:\/\/sdtimes.com\/author\/jennifer-sargent\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Pinecone previews new bulk import feature for its serverless offering - SD Times","description":"The new bulk import feature makes it easier to ingest large amounts of data into Pinecone's serverless infrastructure.","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/sdtimes.com\/data\/pinecone-previews-new-bulk-import-feature-for-its-serverless-offering\/","og_locale":"en_US","og_type":"article","og_title":"Pinecone previews new bulk import feature for its serverless offering - SD Times","og_description":"The new bulk import feature makes it easier to ingest large amounts of data into Pinecone's serverless infrastructure.","og_url":"https:\/\/sdtimes.com\/data\/pinecone-previews-new-bulk-import-feature-for-its-serverless-offering\/","og_site_name":"SD Times","article_publisher":"https:\/\/www.facebook.com\/SDTimesD2","article_published_time":"2024-08-27T14:57:32+00:00","article_modified_time":"2024-08-27T18:08:22+00:00","og_image":[{"width":1280,"height":853,"url":"https:\/\/sdtimes.com\/wp-content\/uploads\/2024\/08\/port-1845350_1280.jpg","type":"image\/jpeg"}],"author":"Jenna Barron","twitter_card":"summary_large_image","twitter_creator":"@sdtimes","twitter_site":"@sdtimes","twitter_misc":{"Written by":"Jenna Barron","Est. reading time":"3 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/sdtimes.com\/data\/pinecone-previews-new-bulk-import-feature-for-its-serverless-offering\/#article","isPartOf":{"@id":"https:\/\/sdtimes.com\/data\/pinecone-previews-new-bulk-import-feature-for-its-serverless-offering\/"},"author":{"name":"Jenna Barron","@id":"https:\/\/sdtimes.com\/#\/schema\/person\/f2524e55ae19da07ea3613577da9f786"},"headline":"Pinecone previews new bulk import feature for its serverless offering","datePublished":"2024-08-27T14:57:32+00:00","dateModified":"2024-08-27T18:08:22+00:00","mainEntityOfPage":{"@id":"https:\/\/sdtimes.com\/data\/pinecone-previews-new-bulk-import-feature-for-its-serverless-offering\/"},"wordCount":440,"publisher":{"@id":"https:\/\/sdtimes.com\/#organization"},"image":{"@id":"https:\/\/sdtimes.com\/data\/pinecone-previews-new-bulk-import-feature-for-its-serverless-offering\/#primaryimage"},"thumbnailUrl":"https:\/\/sdtimes.com\/wp-content\/uploads\/2024\/08\/port-1845350_1280.jpg","keywords":["data","Pinecone"],"articleSection":["Latest News"],"inLanguage":"en-US"},{"@type":"WebPage","@id":"https:\/\/sdtimes.com\/data\/pinecone-previews-new-bulk-import-feature-for-its-serverless-offering\/","url":"https:\/\/sdtimes.com\/data\/pinecone-previews-new-bulk-import-feature-for-its-serverless-offering\/","name":"Pinecone previews new bulk import feature for its serverless offering - SD Times","isPartOf":{"@id":"https:\/\/sdtimes.com\/#website"},"primaryImageOfPage":{"@id":"https:\/\/sdtimes.com\/data\/pinecone-previews-new-bulk-import-feature-for-its-serverless-offering\/#primaryimage"},"image":{"@id":"https:\/\/sdtimes.com\/data\/pinecone-previews-new-bulk-import-feature-for-its-serverless-offering\/#primaryimage"},"thumbnailUrl":"https:\/\/sdtimes.com\/wp-content\/uploads\/2024\/08\/port-1845350_1280.jpg","datePublished":"2024-08-27T14:57:32+00:00","dateModified":"2024-08-27T18:08:22+00:00","description":"The new bulk import feature makes it easier to ingest large amounts of data into Pinecone's serverless infrastructure.","breadcrumb":{"@id":"https:\/\/sdtimes.com\/data\/pinecone-previews-new-bulk-import-feature-for-its-serverless-offering\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/sdtimes.com\/data\/pinecone-previews-new-bulk-import-feature-for-its-serverless-offering\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/sdtimes.com\/data\/pinecone-previews-new-bulk-import-feature-for-its-serverless-offering\/#primaryimage","url":"https:\/\/sdtimes.com\/wp-content\/uploads\/2024\/08\/port-1845350_1280.jpg","contentUrl":"https:\/\/sdtimes.com\/wp-content\/uploads\/2024\/08\/port-1845350_1280.jpg","width":1280,"height":853},{"@type":"BreadcrumbList","@id":"https:\/\/sdtimes.com\/data\/pinecone-previews-new-bulk-import-feature-for-its-serverless-offering\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/sdtimes.com\/"},{"@type":"ListItem","position":2,"name":"Pinecone previews new bulk import feature for its serverless offering"}]},{"@type":"WebSite","@id":"https:\/\/sdtimes.com\/#website","url":"https:\/\/sdtimes.com\/","name":"SD Times","description":"Software Development News","publisher":{"@id":"https:\/\/sdtimes.com\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/sdtimes.com\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/sdtimes.com\/#organization","name":"SD Times","url":"https:\/\/sdtimes.com\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/sdtimes.com\/#\/schema\/logo\/image\/","url":"https:\/\/sdtimes.com\/wp-content\/uploads\/2014\/05\/deafaultlogo.png","contentUrl":"https:\/\/sdtimes.com\/wp-content\/uploads\/2014\/05\/deafaultlogo.png","width":225,"height":90,"caption":"SD Times"},"image":{"@id":"https:\/\/sdtimes.com\/#\/schema\/logo\/image\/"},"sameAs":["https:\/\/www.facebook.com\/SDTimesD2","https:\/\/x.com\/sdtimes","https:\/\/www.linkedin.com\/company\/sdtimes\/"]},{"@type":"Person","@id":"https:\/\/sdtimes.com\/#\/schema\/person\/f2524e55ae19da07ea3613577da9f786","name":"Jenna Barron","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/sdtimes.com\/#\/schema\/person\/image\/b4be3423b187642936e62f121111345e","url":"https:\/\/secure.gravatar.com\/avatar\/b128943929626cdcafccbac86bd306f9?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/b128943929626cdcafccbac86bd306f9?s=96&d=mm&r=g","caption":"Jenna Barron"},"description":"Jenna Barron is News Editor of SD Times.","url":"https:\/\/sdtimes.com\/author\/jennifer-sargent\/"}]}},"_links":{"self":[{"href":"https:\/\/sdtimes.com\/wp-json\/wp\/v2\/posts\/55540"}],"collection":[{"href":"https:\/\/sdtimes.com\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/sdtimes.com\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/sdtimes.com\/wp-json\/wp\/v2\/users\/752"}],"replies":[{"embeddable":true,"href":"https:\/\/sdtimes.com\/wp-json\/wp\/v2\/comments?post=55540"}],"version-history":[{"count":4,"href":"https:\/\/sdtimes.com\/wp-json\/wp\/v2\/posts\/55540\/revisions"}],"predecessor-version":[{"id":55545,"href":"https:\/\/sdtimes.com\/wp-json\/wp\/v2\/posts\/55540\/revisions\/55545"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/sdtimes.com\/wp-json\/wp\/v2\/media\/55541"}],"wp:attachment":[{"href":"https:\/\/sdtimes.com\/wp-json\/wp\/v2\/media?parent=55540"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/sdtimes.com\/wp-json\/wp\/v2\/categories?post=55540"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/sdtimes.com\/wp-json\/wp\/v2\/tags?post=55540"},{"taxonomy":"author","embeddable":true,"href":"https:\/\/sdtimes.com\/wp-json\/wp\/v2\/coauthors?post=55540"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}