-
Notifications
You must be signed in to change notification settings - Fork 0
Expand file tree
/
Copy pathindex.html
More file actions
82 lines (64 loc) · 2.63 KB
/
Copy pathindex.html
File metadata and controls
82 lines (64 loc) · 2.63 KB
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
---
layout: default
title: The Floability Project
---
<style>
.logotitle {
display: block;
margin-left: auto;
margin-right: auto;
width: 90%;
}
</style>
<img src=images/logos/floability-gray.png alt="Floability" class="logotitle">
{% include header.html %}
<p>
The <b>Floability Project</b> is an NSF funded research project to enable the rapid
and portable deployment of notebooks expressing complex scientific workflows across
a wide range of cyberinfrastructure. The key technical challenge is that
<b>workflows are incomplete</b>: the code by itself cannot be moved between facilities
without accurately capturing the software dependencies, required datasets,
and capabilities of the underlying cluster hardware. Our research team at
the University of Notre Dame, the University of Missouri-Columbia, and the University of Illinois
is developing solutions to discover, express, and deploy the complete set of
dependencies needed for complex scientific workflows.
</p>
<hr>
<center>
<p>
<font size=+2>A plain workflow by itself is not portable across facilities:</font>
</p>
<img src=images/cartoons/workflow-fail.png width=80%>
<hr>
<p>
<font size=+2>A complete workflow is captured in a <b>floability backpack</b></font>:
</p>
<table>
<tr>
<td><img src=images/cartoons/floability-backpack.png>
<td>
<ul>
<li> A notebook containing the the scientific workflow.
<li> The software dependencies needed at the manager and worker.
<li> A snapshot or specification of the datasets needed for execution.
<li> A specification of the cluster resources (nodes, memory, GPU, etc) to run the workflow.
</ul>
</td>
</table>
<p>
<font size=+2>The floability software deploys a backpack into an HPC facility:</font>
</p>
<img src=images/cartoons/floability-deploy.png width=80%>
<hr>
<p>
Floability builds on a variety of open source technologies, including <a href=jupyter.org>Jupyter</a> to provide interactive notebook environments, <a href=https://cdmdicewebprd01.dpu.depaul.edu/projects/advancedcontainers/>Sciunit</a> to discover software and data dependencies, <a href=https://ccl.cse.nd.edu/software/taskvine/>TaskVine</a> to express and execute workflows, and <a href=https://conda-forge.org>Conda Forge</a> to provision and deploy software environments.
</p>
<hr>
<table width=100%>
<tr>
<td><img src="images/logos/nsf.png" width=128></td>
<td>This project is supported by the U.S. National Science Foundation under grant OAC-2411436,
<a href=https://www.nsf.gov/awardsearch/showAward?AWD_ID=2411436>CSSI Frameworks: From Notebook to Workflow and Back Again</a></td>
</tr>
</table>
</center>