Building an e-science infrastructure for Astronomy

Building an e-science infrastructure for Astronomy

Building an e-science infrastructure for
Astronomy
L. da Costa
LIneA & ON
LSST Meeting Campos de Jordão, April 11-4
1
www.darkenergysurvey.org
The Dark Energy Survey
DES-Brazil Joined 2007
Blanco 4-meter at CTIO
Stage III DE project using 4
complementary* techniques:
I. Cluster Counts
II. Weak Lensing
III. Large-scale Structure
IV. Supernovae
•
Two multiband surveys:
5000 deg2 grizY to 24th mag
30 deg2 repeat (SNe)
•
Build new 3 deg2 FOV camera
and Data management system
Survey 2012-2017 (525 nights) *in systematics & in cosmological parameter degeneracies
2
*geometric+structure growth: test Dark Energy
2 vs. Gravity
LSST Meeting Campos de Jordão, April 1-4
BPG Joined 2008
APOGEE
BOSS
MarvelsMeeting
LSST
Campos de
SEGUE-II
Jordão,
April 31-4
3
In-kind contribution
• DES
o
o
o
o
QA
Science Portal
Tertiary site
QR
• SDSS
o
o
Mirror site
Interface to SAS
LSST Meeting Campos de Jordão, April 41-4
4
LIneA´s creation
Signed October 29, 2010
LSST Meeting Campos de Jordão, April 51-4
http://www.linea.gov.br/
•
•
12 Technical Staff
30 scientists:
1. AIP
2. OAC
3. Padova
4. UFRJ
5. UFRGS
6. UNESP
7. USP
8. UFF
&
LSST Meeting Campos de Jordão, April 61-4
6
Main goals
• Logistical support to large survey work (management,
collaboration tools, finances)
• Develop e-science infrastructure for:
o
o
o
o
o
Processing
Archiving
Analyzing
Data mining
Data distribution
• Support of other activities
o
o
o
o
o
Helpdesk
Code development environment (science libraries, licenses, code
versioning)
Code inheritance
R&D (workflows, database)
Data Curation
o
o
o
Archival of raw data handled by LNA
Archive of advanced data products
DES, SDSS-III, etc…
LSST Meeting Campos de Jordão, April 71-4
7
LSST Meeting Campos de Jordão, April 81-4
8
Working Model
Users
projects
outsource
LIneA
Code Heritage
Pipelines
Portal
Data server
Real cases
RNP
Data transfer
Data Storage
VO tools
LNCC
HPC
Workflows
Database
LSST Meeting Campos de Jordão, April 91-4
9
Current Resources
• Internal technical team +/- 12 people
• Outsource
o
o
o
o
o
SLACAM – installation, procurement, monitoring and
maintenance
Web designer
DBA
DR9 installation
T&T – software development
• Consultants
LNCC (W. Leo, F. Porto)
o RNP (M. Stanton team)
o COPPE
o CEFET
o
LSST Meeting Campos de Jordão, April10
1-4
10
Software Development
LSST Meeting Campos de Jordão, April11
1-4
11
Examples
• Science codes
o
o
o
o
o
o
o
o
Galaxy model
Chemical evolution model
Galaxy sub-structure
detection
QSO mocks
Clustering
Cluster finder
Simulation and detection
of arcs
Data reduction (QR,
Precam, DECam)
• Portal
infrastructure*
o
• Science
Applications
Image processing*
(Precam, QR)
o QA*
o
• Science Pipelines
o
o
o
o
o
o
Cluster*
Photo-z
MW
QSO (poster)
LSS
GE
Workflows
LSST Meeting Campos de Jordão, April12
1-4
12
LSST Meeting Campos de Jordão, April13
1-4
LSST Meeting Campos de Jordão, April14
1-4
LSST Meeting Campos de Jordão, April15
1-4
LSST Demo Rio March 29-30
15
CTIO
LSST Meeting Campos de Jordão, April16
1-4
16
Observing room 4-m CTIO
LSST Meeting Campos de Jordão, April17
1-4
17
LSST Meeting Campos de Jordão, April18
1-4
LSST Demo Rio March 29-30
18
Presentations & Demos
1. DES Collaboration
o
o
o
o
Collaboration meetings
Review Fermilab Oct 2010
Review University Pennsylvania Oct 2011
Review MPE May 2012
2. LSST
o
o
o
o
SLAC (2009)
University of Washington (2009)
PPARC/Caltech (2010)
ON (2012)
3. Others
o
SAB(2011)
LSST Meeting Campos de Jordão, April19
1-4
19
Portal Reviews
2010 - ”The system is actually much more than a Science Portal, it is a
comprehensive, web-based eScience Analysis Center for the Dark Energy
Survey Collaboration. It is designed to be very general, and allow the
sharing of code, data, and results of analysis world-wide, in a virtual
environment. We don't know that anything quite like it exists yet - it is
forward-looking and ambitious.”
2011 - ”The Brazil Portal concept includes a place where largecollaboration astrophysics analysis can be directed: a central place for
checking in codes; compiling, linking, and running those codes; making
plots and sharing them, all in a repeatable, archived fashion; and the ability
to run things in parallel in larger volume. The vision of the Brazil portal
is commendable and should go forward. The portfolio of tasks is large,
yet the resources to undertake the work are limited. “
LSST Meeting Campos de Jordão, April20
1-4
20
Management
LSST Meeting Campos de Jordão, April21
1-4
21
Project Schedule
Basic pipelines
Phase 1
92 scope documents & interviews
LSST Meeting Campos de Jordão, April22
1-4
22
LSST Meeting Campos de Jordão, April23
1-4
LSST Demo Rio March 29-30
23
Over 800 tasks of approved projects
LSST Meeting Campos de Jordão, April24
1-4
24
Internal wiki
LSST Meeting Campos de Jordão, April25
1-4
25
Helpdesk
LSST
Demosince
Rio March
29-30
1800+LSST
tickets
June
2009
Meeting
Campos
de
Jordão,
April26
1-4
26
Data Center
LSST Meeting Campos de Jordão, April27
1-4
27
Activities
• Process
o
o
o
Local development
Production (for local and international members)
Remote (SINAPAD, UNESP, Fermilab, NCSA)
• Archive
o
o
o
Backups
Catalogs & images
Databases
• Service
o
o
o
o
o
o
o
o
Code repository
Code development and testing
Portal
data distribution
data curation (DES, SDSS, SOAR, Gemini, CFHT)
access to other data sets
VO tools
helpdesk
LSST Meeting Campos de Jordão, April28
1-4
28
Hardware Infrastucture
Number
Crunchers
Database
Current
•
•
•
One site
200 cores
800 TB
Services
End 2012
•
•
•
2 sites
800 cores
800 TB
Storage
LSST Meeting Campos de Jordão, April29
1-4
LSST Demo Rio March 29-30
29
Services
• Software
• System
–
–
–
–
–
APACHE
Rocks
Condor
Globus
Qmail
• WEB Applications
–
–
–
–
–
ClockingIT
Doc-db
twiki
gitweb
trac
• Database
SDSS-II MS SQL
– DES PostgreSQL
–
git
– tawala
– Science libraries
–
• Operations
–
–
–
–
–
–
garbage collector
purge
save
cutout service
view target
data server (casjobs)
• Portal instances
user
– testing
– homolog
– production
–
LSST Meeting Campos de Jordão, April30
1-4
30
New Acquisitions
0.54 PB
+
Altix XE 1300 CLUSTER
(600 Cores, 4800GB Mem)
LSST Meeting Campos de Jordão, April31
1-4
31
Virtual circuits
LSST Meeting Campos de Jordão, April32
1-4
32
Data Distribution
DR8 – skyserver only
DR9 – skyserver, casjobs
LSST Meeting Campos de Jordão, April33
1-4
33
DR9 Implementation
LSST Meeting Campos de Jordão, April34
1-4
Future
LSST Meeting Campos de Jordão, April35
1-4
Long-term view
we are here
LSST Meeting Campos de Jordão, April36
1-4
36
Both scientific & technical
10/29/09
LSST Meeting Campos de Jordão, April37
1-4
37
Summary
• Remarkable progress in a few years
• Work done in coordination with other
MCT institutes
Moving from R&D to operation
environment
LINeA commited to:
•
•
o
o
o
o
invest in e-science
coordinate involvement of Brazilian teams in
large international surveys (DES, SDSS-III,
AS3 ?, LSST ?)
collaborate with LSST DM with no strings
attached
data curation (surveys, LNA)
LSST Meeting Campos de Jordão, April38
1-4
38
extra slides
LSST Meeting Campos de Jordão, April39
1-4
39
Track time + projects => update MS Project
LSST Meeting Campos de Jordão, April40
1-4
40
Tertiary Site Activities
• Contribute to data challenges: mock QSO catalog,
•
•
•
•
•
•
•
•
arcs
Generate Milky Way model (trilegal+).
Generate random catalogs for LSS
Prepare science-driven VAC (LSS, Cluster, GE,
others)
Generate random catalogs for LSS
Quality Assessment (truth table, other authors)
Serve as code repository for the collaboration
Benchmark competing algorithms (cluster finders,
photo-z)
Carry out analysis for collaboration wide papers
41
41
LSST Meeting Campos de Jordão, April 1-4