{"id":543,"date":"2019-08-14T12:16:36","date_gmt":"2019-08-14T12:16:36","guid":{"rendered":"https:\/\/lexis-project.eu\/web\/?page_id=543"},"modified":"2021-10-26T17:24:13","modified_gmt":"2021-10-26T17:24:13","slug":"data-management-layer","status":"publish","type":"page","link":"https:\/\/lexis-project.eu\/web\/lexis-platform\/data-management-layer\/","title":{"rendered":"Data Management Layer"},"content":{"rendered":"\n<p>The LEXIS Data Management layer, built on top of the infrastructure layer, will connect the participating HPC and HPDA sites together. It provides an optimum basis for a consistent data-management process in the LEXIS framework, as required for Big Data analytics and HPDA. <\/p>\n\n\n\n<p>As a core of the Distributed Data Infrastructure (DDI) to be set up, we deploy an iRODS- and EUDAT-based data-management system across LEXIS sites. On top of this system, where data can be accessed transparently from all sites, we build REST APIs in order for the LEXIS ecosystem (orchestrator, portal, billing engine) to smoothly interact with the data layer. Monitoring functionalities are implemented as well, and can be utilised for billing as well as for performance optimisation of the LEXIS data infrastructure.<\/p>\n\n\n\n<div class=\"wp-block-columns has-2-columns\">\n<div class=\"wp-block-column\">\n<div class=\"wp-block-image\"><figure class=\"aligncenter is-resized\"><a href=\"https:\/\/lexis-project.eu\/web\/wp-content\/uploads\/2019\/10\/dataManagementContent1.jpg\" rel=\"1\"><img loading=\"lazy\" src=\"https:\/\/lexis-project.eu\/web\/wp-content\/uploads\/2019\/10\/dataManagementContent1-1024x434.jpg\" alt=\"\" class=\"wp-image-1256\" width=\"400\" height=\"168\" srcset=\"https:\/\/lexis-project.eu\/web\/wp-content\/uploads\/2019\/10\/dataManagementContent1-300x127.jpg 300w, https:\/\/lexis-project.eu\/web\/wp-content\/uploads\/2019\/10\/dataManagementContent1-768x325.jpg 768w, https:\/\/lexis-project.eu\/web\/wp-content\/uploads\/2019\/10\/dataManagementContent1.jpg 1920w\" sizes=\"(max-width: 400px) 100vw, 400px\" \/><\/a><\/figure><\/div>\n\n\n\n<p class=\"has-text-align-center\">\nThe LEXIS data-management layer consists of the Data System Core (green \nrectangle &#8211; Distributed Data Infrastructure with APIs) and local storage\n systems.\n\n<\/p>\n<\/div>\n\n\n\n<div class=\"wp-block-column\">\n<div class=\"wp-block-image\"><figure class=\"aligncenter is-resized\"><a href=\"https:\/\/lexis-project.eu\/web\/wp-content\/uploads\/2019\/10\/dataManagementContent2.jpg\" rel=\"1\"><img loading=\"lazy\" src=\"https:\/\/lexis-project.eu\/web\/wp-content\/uploads\/2019\/10\/dataManagementContent2-629x1024.jpg\" alt=\"\" class=\"wp-image-1257\" width=\"103\" height=\"168\" srcset=\"https:\/\/lexis-project.eu\/web\/wp-content\/uploads\/2019\/10\/dataManagementContent2-629x1024.jpg 629w, https:\/\/lexis-project.eu\/web\/wp-content\/uploads\/2019\/10\/dataManagementContent2-184x300.jpg 184w, https:\/\/lexis-project.eu\/web\/wp-content\/uploads\/2019\/10\/dataManagementContent2-768x1251.jpg 768w, https:\/\/lexis-project.eu\/web\/wp-content\/uploads\/2019\/10\/dataManagementContent2.jpg 1179w\" sizes=\"(max-width: 103px) 100vw, 103px\" \/><\/a><\/figure><\/div>\n\n\n\n<p class=\"has-text-align-center\">\nA moderately-sized local storage system (LEXIS experimental storage, 150TB) installed at LRZ\n\n<\/p>\n<\/div>\n<\/div>\n","protected":false},"excerpt":{"rendered":"<p>The LEXIS Data Management layer, built on top of the infrastructure layer, will connect the participating HPC and HPDA sites together. It provides an optimum basis for a consistent data-management process in the LEXIS framework, as required for Big Data analytics and HPDA. As a core of the Distributed Data Infrastructure (DDI) to be set [&hellip;]<\/p>\n","protected":false},"author":1,"featured_media":0,"parent":456,"menu_order":0,"comment_status":"closed","ping_status":"closed","template":"","meta":[],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v16.6.1 - https:\/\/yoast.com\/wordpress\/plugins\/seo\/ -->\r\n<title>Data Management Layer - LEXIS project \/ LEXIS Platform<\/title>\r\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\r\n<link rel=\"canonical\" href=\"https:\/\/lexis-project.eu\/web\/lexis-platform\/data-management-layer\/\" \/>\r\n<meta property=\"og:locale\" content=\"en_GB\" \/>\r\n<meta property=\"og:type\" content=\"article\" \/>\r\n<meta property=\"og:title\" content=\"Data Management Layer - LEXIS project \/ LEXIS Platform\" \/>\r\n<meta property=\"og:description\" content=\"The LEXIS Data Management layer, built on top of the infrastructure layer, will connect the participating HPC and HPDA sites together. It provides an optimum basis for a consistent data-management process in the LEXIS framework, as required for Big Data analytics and HPDA. As a core of the Distributed Data Infrastructure (DDI) to be set [&hellip;]\" \/>\r\n<meta property=\"og:url\" content=\"https:\/\/lexis-project.eu\/web\/lexis-platform\/data-management-layer\/\" \/>\r\n<meta property=\"og:site_name\" content=\"LEXIS project \/ LEXIS Platform\" \/>\r\n<meta property=\"article:modified_time\" content=\"2021-10-26T17:24:13+00:00\" \/>\r\n<meta property=\"og:image\" content=\"https:\/\/lexis-project.eu\/web\/wp-content\/uploads\/2019\/10\/dataManagementContent1-1024x434.jpg\" \/>\r\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\r\n<meta name=\"twitter:label1\" content=\"Estimated reading time\" \/>\n\t<meta name=\"twitter:data1\" content=\"2 minutes\" \/>\r\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"WebSite\",\"@id\":\"https:\/\/lexis-project.eu\/web\/#website\",\"url\":\"https:\/\/lexis-project.eu\/web\/\",\"name\":\"LEXIS project \/ LEXIS Platform\",\"description\":\"\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/lexis-project.eu\/web\/?s={search_term_string}\"},\"query-input\":\"required name=search_term_string\"}],\"inLanguage\":\"en-GB\"},{\"@type\":\"ImageObject\",\"@id\":\"https:\/\/lexis-project.eu\/web\/lexis-platform\/data-management-layer\/#primaryimage\",\"inLanguage\":\"en-GB\",\"url\":\"https:\/\/lexis-project.eu\/web\/wp-content\/uploads\/2019\/10\/dataManagementContent1.jpg\",\"contentUrl\":\"https:\/\/lexis-project.eu\/web\/wp-content\/uploads\/2019\/10\/dataManagementContent1.jpg\",\"width\":1920,\"height\":813},{\"@type\":\"WebPage\",\"@id\":\"https:\/\/lexis-project.eu\/web\/lexis-platform\/data-management-layer\/#webpage\",\"url\":\"https:\/\/lexis-project.eu\/web\/lexis-platform\/data-management-layer\/\",\"name\":\"Data Management Layer - LEXIS project \/ LEXIS Platform\",\"isPartOf\":{\"@id\":\"https:\/\/lexis-project.eu\/web\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\/\/lexis-project.eu\/web\/lexis-platform\/data-management-layer\/#primaryimage\"},\"datePublished\":\"2019-08-14T12:16:36+00:00\",\"dateModified\":\"2021-10-26T17:24:13+00:00\",\"breadcrumb\":{\"@id\":\"https:\/\/lexis-project.eu\/web\/lexis-platform\/data-management-layer\/#breadcrumb\"},\"inLanguage\":\"en-GB\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/lexis-project.eu\/web\/lexis-platform\/data-management-layer\/\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/lexis-project.eu\/web\/lexis-platform\/data-management-layer\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/lexis-project.eu\/web\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"LEXIS Platform\",\"item\":\"https:\/\/lexis-project.eu\/web\/lexis-platform\/\"},{\"@type\":\"ListItem\",\"position\":3,\"name\":\"Data Management Layer\"}]}]}<\/script>\r\n<!-- \/ Yoast SEO plugin. -->","_links":{"self":[{"href":"https:\/\/lexis-project.eu\/web\/wp-json\/wp\/v2\/pages\/543"}],"collection":[{"href":"https:\/\/lexis-project.eu\/web\/wp-json\/wp\/v2\/pages"}],"about":[{"href":"https:\/\/lexis-project.eu\/web\/wp-json\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"https:\/\/lexis-project.eu\/web\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/lexis-project.eu\/web\/wp-json\/wp\/v2\/comments?post=543"}],"version-history":[{"count":8,"href":"https:\/\/lexis-project.eu\/web\/wp-json\/wp\/v2\/pages\/543\/revisions"}],"predecessor-version":[{"id":2682,"href":"https:\/\/lexis-project.eu\/web\/wp-json\/wp\/v2\/pages\/543\/revisions\/2682"}],"up":[{"embeddable":true,"href":"https:\/\/lexis-project.eu\/web\/wp-json\/wp\/v2\/pages\/456"}],"wp:attachment":[{"href":"https:\/\/lexis-project.eu\/web\/wp-json\/wp\/v2\/media?parent=543"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}