NSF CC* Data Storage

High Volume Data Storage Infrastructure for Scientific Research and Education at Kennesaw State University Shared as Open Science Data Federation Data Origin

The NSF Campus Cyberinfrastructure (CC*) program invests in coordinated campus-level cyberinfrastructure improvements, innovation, integration, and engineering for science applications and distributed research projects.

The KSU proposal intends to develop a high-capacity storage system with around 4.3PB overall usable storage as an Open Science Data Federation (OSDF) data origin to support scientific research and education activities on both campuses of Kennesaw State University (KSU). 30% of the storage is to be allocated for hosting datasets of external researchers and sharing KSU spawned datasets to empower national research projects.  You can learn more in the KSU's Proposal Abstract and in the NSF Award posting.  

Progress

  • Date
    Update
  • June 17
    SOX will switch to jumbo frames for Internet2 pipeline. (tentative date)
  • June
    Transceivers for 25GB connectivity are expected to be received and tested.
  • Mid-May
    SDSC has been given access for Kubernetes node configuration.
  • Mid-May
    CC* K8 node connected to 100 GB connection for setup and configuration (to be downgraded to 25 GB for production).
  • Week of 05/01/24
    Inter-campus link upgraded to 100GB
  • Week of 04/18/24
    Campus link to Internet2 upgraded to 100GB
  • Week of 04/17/24
    Seminar: ACCESSing Advanced National Supercomuting and Storage Resources for Computational Research: description, slides and video available.
  • March
    Investigating network switch issues with a variety of transceivers.
  • Early March
    Open Data Committee Meeting: Planning for upcoming seminars.
  • Late February
    Resolving issues, cluster is reporting as healthy
  • Mid February
    Issue with proxy and a disk reporting as bad.
  • Week of 02/05/24
    Configurations for CRUSH maps and erasure encoding.
  • Early February
    Proxies created for internal and external networks
  • Week of 01/29/24
    cephadm Orchestration tool configured for OSD daemons
  • Week of 01/22/24
    Disk discussion with UCSD and OSDs manually configured to use NVME disks 
  • Week of 01/15/24
    Ceph installation started
  • Week of 01/08/24
    Benchmarking: network and I/O
  • Week of 01/08/24
    Docker installation/configuration
  • Week of 12/11/23
    System configuration for private network
  • Week of 12/04/23
    OS installations
  • Mid-November
    Private networking created for system
  • Week of 10/02/23
    Hardware installed in server room
  • Week of 09/29/23
  • Late September 2023
     NSF CC* Workshop
  • September 2023
    OpenData Committee formed
  • Early September 2023
    Introductions to UCSD contacts 
  • August 2023
    KSU hardware purchase completed
  • Summer 2023
    Internet2 connection to campus made

 

©