Zum Inhalt

Datafactory Project Outline

Slide deck Poster

Proposal

Datafactory will build a private Cloud for production services at TU Wien. This mainly means Platform-as-a-Service (PaaS) and Software-as-a-Service (SaaS) offerings supporting the PaaS. Datafactory will be made available to our customers via a self-service portal.

The Cloud will be based on the learnings made by DataLab in recent years. This project will build a resilient and fault tolerant Infrastructure-as-a-Service layer (IaaS) and services on top of that layer that add capabilities needed for administrative and teaching services.

Datafactory aims to - enable self-service and elasticity, - offer redundancy at the infrastructure level and fault tolerance, - be easy to use and operate.

Scope

Goals

Datafactory will build:

  • IaaS (OpenStack) for the use of the other layers,
  • PaaS (OpenShift and probably OKD),
  • SaaS: selected offerings starting with DBaas, DNS, and Authentication/Authorization for DataFactory and the services running on it,
  • customer facing Self-service portal and API.

Services will be provided to customers based on a maturity model, i.e. there will be sandboxes, test services and production services and a path to follow when customer projects 'climb up the ladder'.

Non-Goals

Datafactory will not:

  • host scientific workload like HPC or AI training,
  • offer managed Clusters as a Service to customers,
  • give administrative permissions to customers (shared responsibility),
  • offer IaaS to customers directly,
  • offer application maintenance and operations beyond the platform level.

Customers

Datafactory will offer services to:

  • ourselves (Campus IT and DataLab),
  • Software Developers of all kind at Campus IT,
  • Institutes and faculties for their administrative workloads.

People

Core Team

  • Simon
  • Hadi
  • Mostafa
  • Nikolaus
  • Arthur
  • Gudrun

Extended Team

  • Nova (product management and politics)
  • Ernst (money and architecture)
  • Florian and Emmanuel

Environment

  • 'CSD' and Elearning
  • Campus IT
  • Institutes, faculties (via their TUAdmins)
  • Wolfgang
  • Rectorate

Milestones

  1. Hardware is available for installation (racks are ready, network is running, IaaS can be set up).
  2. IaaS (OpenStack and Storage) is running (full cluster, in one datacenter).
  3. Authentication and Authorization are in place and usable.
  4. Self-service portal is ready for users.
  5. OpenStack is distributed over 3 datacenters.