{"id":1436,"date":"2019-11-13T10:19:56","date_gmt":"2019-11-13T10:19:56","guid":{"rendered":"https:\/\/lexis-project.eu\/web\/?post_type=publication&#038;p=1436"},"modified":"2020-09-28T07:34:13","modified_gmt":"2020-09-28T07:34:13","slug":"the-lexis-approach-to-searching-and-managing-fair-research-data-in-converged-hpc-cloud-big-data-architectures","status":"publish","type":"publication","link":"https:\/\/lexis-project.eu\/web\/publication\/the-lexis-approach-to-searching-and-managing-fair-research-data-in-converged-hpc-cloud-big-data-architectures\/","title":{"rendered":"The LEXIS approach to Searching and Managing FAIR Research Data in Converged HPC-Cloud-Big Data Architectures"},"content":{"rendered":"\n<p>Stephan Hachinger<sup>1<\/sup>, Jan Martinovic<sup>2<\/sup>, Olivier Terzo<sup>3<\/sup>, C\u00e9dric Koch-Hofer<sup>4<\/sup>, Martin Golasowski<sup>2<\/sup>, Mohamad Hayek<sup>1<\/sup>, Marc Levrier<sup>4<\/sup>, Alberto Scionti<sup>3<\/sup>, Donato Magarielli5, Thierry Goubier<sup>6<\/sup>, Antonio Parodi<sup>7<\/sup>, Sean Murphy<sup>8<\/sup>, Florin-Ionut Apopei<sup>9<\/sup>, Carmine D&#8217;Amico<sup>3<\/sup>, Simone Ciccia<sup>3<\/sup>, Massimo Sardo<sup>7<\/sup>, Danijel Schorlemmer<sup>10<\/sup><\/p>\n\n\n\n<p><sup>1<\/sup>Leibniz Supercomputing Centre (LRZ), Bavarian Academy of Sciences and Humanities, Garching, Germany<br><sup>2<\/sup>T4Innovations, V\u0160B &#8211; Technical University of Ostrava, Ostrava-Poruba, Czech Republic<br><sup>3<\/sup>Advanced Computing and Applications, LINKS Foundation, Torino, Italy<br><sup>4<\/sup>ATOS, Paris, France<br><sup>5<\/sup>Avio Aero, Torino, Italy<br><sup>6<\/sup>CEA, LIST, Paris, France<br><sup>7<\/sup>CIMA Research Foundation, Savona, Italy<br><sup>8<\/sup>Cyclops Labs GmbH, Winterthur, Switzerland<br><sup>9<\/sup>TESEO, Torino, Italy<br><sup>10<\/sup>GFZ German Research Centre for Geosciences, Potsdam, Germany<\/p>\n\n\n\n<p>The enormous amounts of data generated in modern industry, business and science pose a significant challenge to those extracting actionable intelligence from data using various filtering and analysis techniques. In this &#8220;Big Data&#8221; setting, the LEXIS project (Large-scale EXecution for Industry &amp; Society) provides a platform for optimised execution of Cloud-HPC workflows, reducing computation time and energy efficiency. The system will rely on advanced, distributed orchestration solutions (Bull Ystia Orchestrator, based on TOSCA and Alien4Cloud technologies), the High-End Application Execution Middleware HEAppE, and new hardware capabilities for maximizing efficiency in data processing, analysis and transfer (e.g. Burst Buffers with GPU- and FPGA-based data reprocessing).<\/p>\n\n\n\n<p>LEXIS handles computation tasks and data from three Pilots, based on representative and demanding HPC\/Cloud-Computing use cases in Industry (SMEs) and Science: i) Simulations of of complex turbo- machinery and gearbox systems in Aeronautics, ii) Earthquake and Tsunami simulations which are accelerated to enable accurate real-time analysis, and iii) Weather and Climate simulations where massive amounts of in situ data are assimilated to improve forecasts. A user-friendly LEXIS web portal, as a unique entry point, will provide access to data as well as workflow-handling and remote visualization functionality.<\/p>\n\n\n\n<p>The &#8220;LEXIS Data System&#8221; constitutes the data back-end for the project. At its core, a Distributed Data Infrastructure (DDI) ensures the availability of LEXIS data at all participating HPC sites, and provides functionality for FAIR (&#8220;Findable, Interoperable, Accessible, Reusable&#8221;) Research Data Management. The DDI leverages best of breed data-management solutions of EUDAT, including B2SAFE and B2HANDLE. Via DOI acquisition, open data products can be published and disseminated. Exposing metadata via standardized REST interfaces, the DDI will be a best-practice example for demonstrating the connection of Research Data Infrastructures to specialized and general-purpose search facilities (internal data search, B2FIND, GeRDI, web search engines). Making research data findable in such ways proves essential for data sharing and re-use within research communities.<\/p>\n","protected":false},"author":1,"featured_media":0,"template":"","publication_tag":[],"publication_category":[17],"publication_pilot":[26],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v16.6.1 - https:\/\/yoast.com\/wordpress\/plugins\/seo\/ -->\r\n<title>The LEXIS approach to Searching and Managing FAIR Research Data in Converged HPC-Cloud-Big Data Architectures - LEXIS project \/ LEXIS Platform<\/title>\r\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\r\n<link rel=\"canonical\" href=\"https:\/\/lexis-project.eu\/web\/publication\/the-lexis-approach-to-searching-and-managing-fair-research-data-in-converged-hpc-cloud-big-data-architectures\/\" \/>\r\n<meta property=\"og:locale\" content=\"en_GB\" \/>\r\n<meta property=\"og:type\" content=\"article\" \/>\r\n<meta property=\"og:title\" content=\"The LEXIS approach to Searching and Managing FAIR Research Data in Converged HPC-Cloud-Big Data Architectures - LEXIS project \/ LEXIS Platform\" \/>\r\n<meta property=\"og:description\" content=\"Stephan Hachinger1, Jan Martinovic2, Olivier Terzo3, C\u00e9dric Koch-Hofer4, Martin Golasowski2, Mohamad Hayek1, Marc Levrier4, Alberto Scionti3, Donato Magarielli5, Thierry Goubier6, Antonio Parodi7, Sean Murphy8, Florin-Ionut Apopei9, Carmine D&#8217;Amico3, Simone Ciccia3, Massimo Sardo7, Danijel Schorlemmer10 1Leibniz Supercomputing Centre (LRZ), Bavarian Academy of Sciences and Humanities, Garching, Germany2T4Innovations, V\u0160B &#8211; Technical University of Ostrava, Ostrava-Poruba, Czech Republic3Advanced [&hellip;]\" \/>\r\n<meta property=\"og:url\" content=\"https:\/\/lexis-project.eu\/web\/publication\/the-lexis-approach-to-searching-and-managing-fair-research-data-in-converged-hpc-cloud-big-data-architectures\/\" \/>\r\n<meta property=\"og:site_name\" content=\"LEXIS project \/ LEXIS Platform\" \/>\r\n<meta property=\"article:modified_time\" content=\"2020-09-28T07:34:13+00:00\" \/>\r\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\r\n<meta name=\"twitter:label1\" content=\"Estimated reading time\" \/>\n\t<meta name=\"twitter:data1\" content=\"2 minutes\" \/>\r\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"WebSite\",\"@id\":\"https:\/\/lexis-project.eu\/web\/#website\",\"url\":\"https:\/\/lexis-project.eu\/web\/\",\"name\":\"LEXIS project \/ LEXIS Platform\",\"description\":\"\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/lexis-project.eu\/web\/?s={search_term_string}\"},\"query-input\":\"required name=search_term_string\"}],\"inLanguage\":\"en-GB\"},{\"@type\":\"WebPage\",\"@id\":\"https:\/\/lexis-project.eu\/web\/publication\/the-lexis-approach-to-searching-and-managing-fair-research-data-in-converged-hpc-cloud-big-data-architectures\/#webpage\",\"url\":\"https:\/\/lexis-project.eu\/web\/publication\/the-lexis-approach-to-searching-and-managing-fair-research-data-in-converged-hpc-cloud-big-data-architectures\/\",\"name\":\"The LEXIS approach to Searching and Managing FAIR Research Data in Converged HPC-Cloud-Big Data Architectures - LEXIS project \/ LEXIS Platform\",\"isPartOf\":{\"@id\":\"https:\/\/lexis-project.eu\/web\/#website\"},\"datePublished\":\"2019-11-13T10:19:56+00:00\",\"dateModified\":\"2020-09-28T07:34:13+00:00\",\"breadcrumb\":{\"@id\":\"https:\/\/lexis-project.eu\/web\/publication\/the-lexis-approach-to-searching-and-managing-fair-research-data-in-converged-hpc-cloud-big-data-architectures\/#breadcrumb\"},\"inLanguage\":\"en-GB\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/lexis-project.eu\/web\/publication\/the-lexis-approach-to-searching-and-managing-fair-research-data-in-converged-hpc-cloud-big-data-architectures\/\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/lexis-project.eu\/web\/publication\/the-lexis-approach-to-searching-and-managing-fair-research-data-in-converged-hpc-cloud-big-data-architectures\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/lexis-project.eu\/web\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Publications\",\"item\":\"https:\/\/lexis.it4i.cz\/web\/publications\/\"},{\"@type\":\"ListItem\",\"position\":3,\"name\":\"The LEXIS approach to Searching and Managing FAIR Research Data in Converged HPC-Cloud-Big Data Architectures\"}]}]}<\/script>\r\n<!-- \/ Yoast SEO plugin. -->","_links":{"self":[{"href":"https:\/\/lexis-project.eu\/web\/wp-json\/wp\/v2\/publication\/1436"}],"collection":[{"href":"https:\/\/lexis-project.eu\/web\/wp-json\/wp\/v2\/publication"}],"about":[{"href":"https:\/\/lexis-project.eu\/web\/wp-json\/wp\/v2\/types\/publication"}],"author":[{"embeddable":true,"href":"https:\/\/lexis-project.eu\/web\/wp-json\/wp\/v2\/users\/1"}],"wp:attachment":[{"href":"https:\/\/lexis-project.eu\/web\/wp-json\/wp\/v2\/media?parent=1436"}],"wp:term":[{"taxonomy":"publication_tag","embeddable":true,"href":"https:\/\/lexis-project.eu\/web\/wp-json\/wp\/v2\/publication_tag?post=1436"},{"taxonomy":"publication_category","embeddable":true,"href":"https:\/\/lexis-project.eu\/web\/wp-json\/wp\/v2\/publication_category?post=1436"},{"taxonomy":"publication_pilot","embeddable":true,"href":"https:\/\/lexis-project.eu\/web\/wp-json\/wp\/v2\/publication_pilot?post=1436"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}