39
ALeRCE collaboration: Danilo Alvares, Javier Arredondo, Nicolás Astorga, Franz Bauer, Guillermo Cabrera-Vives, Rodrigo Carrasco-Davis, Ernesto Castillo, Márcio Catelan, Andrew Connolly, Demetra De Cicco, Cristóbal Donoso, Felipe Elorrieta, Pablo Estévez, Susana Eyheramendy, Francisco Förster, Germán García, Matthew Graham, Pablo Huijse, Ashish Mahabal, Giovanni Motta, Rosario Molina, Giuliano Pignata, Pavlos Protopapas, Esteban Reyes, Ignacio Reyes, Diego Rodríguez, Daniela Ruz, Juan Sáez, Paula Sánchez-Sáez, Camilo Valenzuela, Jorge Vergara High cadence surveys and the future ecosystem of time domain astronomy http://alerce.science/

Jorge Vergara , Germán García, Matthew Graham, Pablo ... · ~104 visual inspections, 125 SNe Slew 30 s Exposure 87 s Readout 17 s CTIO-La Serena transfer: 120 s La Serena-Santiago

  • Upload
    others

  • View
    4

  • Download
    0

Embed Size (px)

Citation preview

Page 1: Jorge Vergara , Germán García, Matthew Graham, Pablo ... · ~104 visual inspections, 125 SNe Slew 30 s Exposure 87 s Readout 17 s CTIO-La Serena transfer: 120 s La Serena-Santiago

ALeRCE collaboration: Danilo Alvares, Javier Arredondo, Nicolás Astorga, Franz Bauer, Guillermo Cabrera-Vives, Rodrigo Carrasco-Davis, Ernesto Castillo, Márcio Catelan, Andrew Connolly, Demetra De Cicco, Cristóbal Donoso, Felipe Elorrieta, Pablo Estévez, Susana

Eyheramendy, Francisco Förster, Germán García, Matthew Graham, Pablo Huijse, Ashish Mahabal, Giovanni Motta, Rosario Molina, Giuliano Pignata, Pavlos Protopapas, Esteban Reyes, Ignacio Reyes, Diego Rodríguez, Daniela Ruz, Juan Sáez, Paula Sánchez-Sáez, Camilo Valenzuela,

Jorge Vergara

High cadence surveys and the future ecosystem of time domain astronomy

http://alerce.science/

Page 2: Jorge Vergara , Germán García, Matthew Graham, Pablo ... · ~104 visual inspections, 125 SNe Slew 30 s Exposure 87 s Readout 17 s CTIO-La Serena transfer: 120 s La Serena-Santiago
Page 3: Jorge Vergara , Germán García, Matthew Graham, Pablo ... · ~104 visual inspections, 125 SNe Slew 30 s Exposure 87 s Readout 17 s CTIO-La Serena transfer: 120 s La Serena-Santiago

Overview:1. High cadence surveys & time domain ecosystem

2. The High cadence Transient Survey (HiTS)

3. The ALeRCE broker

4. DEMO!

Page 4: Jorge Vergara , Germán García, Matthew Graham, Pablo ... · ~104 visual inspections, 125 SNe Slew 30 s Exposure 87 s Readout 17 s CTIO-La Serena transfer: 120 s La Serena-Santiago

1. High cadence surveys & the

time domain ecosystem

Page 5: Jorge Vergara , Germán García, Matthew Graham, Pablo ... · ~104 visual inspections, 125 SNe Slew 30 s Exposure 87 s Readout 17 s CTIO-La Serena transfer: 120 s La Serena-Santiago

Transient landscape

Credit: M. Kasliwal (2012)

SBO

Burton+2016

Page 6: Jorge Vergara , Germán García, Matthew Graham, Pablo ... · ~104 visual inspections, 125 SNe Slew 30 s Exposure 87 s Readout 17 s CTIO-La Serena transfer: 120 s La Serena-Santiago

Survey telescopes

Yasuda+2019

Page 7: Jorge Vergara , Germán García, Matthew Graham, Pablo ... · ~104 visual inspections, 125 SNe Slew 30 s Exposure 87 s Readout 17 s CTIO-La Serena transfer: 120 s La Serena-Santiago

Survey telescopes

HSC, 1.8 deg2

Laher+2017

Page 8: Jorge Vergara , Germán García, Matthew Graham, Pablo ... · ~104 visual inspections, 125 SNe Slew 30 s Exposure 87 s Readout 17 s CTIO-La Serena transfer: 120 s La Serena-Santiago

Current follow up strategies

>1 day cadence~min cadence

Proactive strategyDWF (~1 min @ DECam)

Andreoni+17,19

KEGS (30 min @ Kepler), Shaya+15PS1/MDS (30 min @ PS1),Berger+13SHOOTS (60 min @ HSC), Tanaka+16HiTS (100 min @ DECam), Förster+16

~hour cadence

Fast robotic telescopes(shallow)

Page 9: Jorge Vergara , Germán García, Matthew Graham, Pablo ... · ~104 visual inspections, 125 SNe Slew 30 s Exposure 87 s Readout 17 s CTIO-La Serena transfer: 120 s La Serena-Santiago

Future time domain astronomy ecosystem

Survey telescopes

Alert brokers/TOMs

Follow up telescopes

Page 10: Jorge Vergara , Germán García, Matthew Graham, Pablo ... · ~104 visual inspections, 125 SNe Slew 30 s Exposure 87 s Readout 17 s CTIO-La Serena transfer: 120 s La Serena-Santiago

API

Interoperable tools for new discoveries

Page 11: Jorge Vergara , Germán García, Matthew Graham, Pablo ... · ~104 visual inspections, 125 SNe Slew 30 s Exposure 87 s Readout 17 s CTIO-La Serena transfer: 120 s La Serena-Santiago

Tools for time domain astronomy

Acquisition & processing

Survey telescopes:image processing,

real/bogus filtering

Alert filtering & classification

Brokers:aggregation,

crossmatching,ML classification

Physical interpretation

NAOJ

Analysis:modeling, inference

(e.g. MCMC), prediction

Prioritization & follow-up

TOMs & follow-up telescopes:

resource optimization & communication

(APIs), actionable ML

Page 12: Jorge Vergara , Germán García, Matthew Graham, Pablo ... · ~104 visual inspections, 125 SNe Slew 30 s Exposure 87 s Readout 17 s CTIO-La Serena transfer: 120 s La Serena-Santiago

2. High Cadence Transient

Survey (HiTS)

Page 13: Jorge Vergara , Germán García, Matthew Graham, Pablo ... · ~104 visual inspections, 125 SNe Slew 30 s Exposure 87 s Readout 17 s CTIO-La Serena transfer: 120 s La Serena-Santiago

The High cadence Transient Survey (HiTS)

Page 14: Jorge Vergara , Germán García, Matthew Graham, Pablo ... · ~104 visual inspections, 125 SNe Slew 30 s Exposure 87 s Readout 17 s CTIO-La Serena transfer: 120 s La Serena-Santiago

Pipeline flow outline

~1012 pixels, ~108 candidates, ~106 filtered candidates (ML)

~104 visual inspections, 125 SNe

Slew30 s

Exposure87 s

Readout17 s

CTIO-La Serena transfer: 120 s

La Serena-Santiago transfer: 10 s

DECam comm. pipeline ~80 s

Image differencepipeline 60 s

CRBlaster~20 s

Visual Inspection<120 s

5-6 min lag Real bogusclassifier

Page 15: Jorge Vergara , Germán García, Matthew Graham, Pablo ... · ~104 visual inspections, 125 SNe Slew 30 s Exposure 87 s Readout 17 s CTIO-La Serena transfer: 120 s La Serena-Santiago

● 320 deg2 deep & high cadence survey, 1st real time analysis of DECam (Feb 2014), 125 SNe!

● Supernova shock breakout model constraints (Förster+16, ApJ)

● 1st deep learning real/bogus classifier (Cabrera-Vives+16,17; Reyes+18, Huijse+18, Astorga+18)

● Distant RR Lyrae to probe outer MW (Medina+17,18, ApJ)

● ~10k new asteroids (Peña+18, AJ)

● ~22M public variable catalog (Martínez+18, AJ)

● Evidence for CSM around most SNe II (Förster+18, Nat. Ast.)

● 1st CRNN image sequence classifier (Carrasco-Davis+19, PASP)

● New population of intermediate mass black holes (Martínez-Palomera, submitted)

HiTS in a nutshell

Page 16: Jorge Vergara , Germán García, Matthew Graham, Pablo ... · ~104 visual inspections, 125 SNe Slew 30 s Exposure 87 s Readout 17 s CTIO-La Serena transfer: 120 s La Serena-Santiago

Physical processes and timescales in supernovae

Mins Hour Day Few days Week Month

RSG high ρenv. SBO

WR wind SBO

RSG low ρ wind/atm.

SBO

WR wind/atm.

cooling

RSG env.coolingYSG env.

cooling

RSG extreme mass loss

SBORSG

recombinationBSG high ρenv. SBO

Year

56Co→ 56Fetail

YSG high ρenv. SBO

BSG env. cooling

56Ni→56Cobulk diffusion

56Ni→56Coouter layers diffusion

Shock breakout

Shock cooling

Diffusion

Page 17: Jorge Vergara , Germán García, Matthew Graham, Pablo ... · ~104 visual inspections, 125 SNe Slew 30 s Exposure 87 s Readout 17 s CTIO-La Serena transfer: 120 s La Serena-Santiago

Type II SNe: characteristic timescales and luminosities

Gezari+2015

SHOOTS @ HSC

Tanaka+2016

Rising time scale [day mag-1]

Tominaga+2019

Decline time scale [day mag-1]

SBO?

Page 18: Jorge Vergara , Germán García, Matthew Graham, Pablo ... · ~104 visual inspections, 125 SNe Slew 30 s Exposure 87 s Readout 17 s CTIO-La Serena transfer: 120 s La Serena-Santiago

Type II SNe: detailed modeling and inference

Models & inference: Moriya+18 & Förster+18

LiteratureSN20016bp: Quimby+2007PS1-13arp: Gezari+2015SN2013fs: Yaron+2017KSN2011a/d: Garnavich+2016

HiTS light curves

Page 19: Jorge Vergara , Germán García, Matthew Graham, Pablo ... · ~104 visual inspections, 125 SNe Slew 30 s Exposure 87 s Readout 17 s CTIO-La Serena transfer: 120 s La Serena-Santiago

Dense CSM around type II SNe just before explosion

Förster et al. 2018, Nature Astronomy

NAOJ

Page 20: Jorge Vergara , Germán García, Matthew Graham, Pablo ... · ~104 visual inspections, 125 SNe Slew 30 s Exposure 87 s Readout 17 s CTIO-La Serena transfer: 120 s La Serena-Santiago

3. Automatic Learning for the

Rapid Classification of Events

(ALeRCE)

Page 21: Jorge Vergara , Germán García, Matthew Graham, Pablo ... · ~104 visual inspections, 125 SNe Slew 30 s Exposure 87 s Readout 17 s CTIO-La Serena transfer: 120 s La Serena-Santiago

ALeRCE: from HiTS to LSST

~10-100x~1-10x

Page 22: Jorge Vergara , Germán García, Matthew Graham, Pablo ... · ~104 visual inspections, 125 SNe Slew 30 s Exposure 87 s Readout 17 s CTIO-La Serena transfer: 120 s La Serena-Santiago

Astronomical infrastructure in Chile

TAOE-ELT

LSST

ALMA

SOAR

La Silla

CTIO

VLT

CTAGMT

CCAT

Magellan

VISTA

Gemini

Chilean institutions: access to ~10% observing time

Page 23: Jorge Vergara , Germán García, Matthew Graham, Pablo ... · ~104 visual inspections, 125 SNe Slew 30 s Exposure 87 s Readout 17 s CTIO-La Serena transfer: 120 s La Serena-Santiago

ALeRCE is a Chilean-led initiative to build a community broker for LSST and other large etendue

survey telescopes

Page 24: Jorge Vergara , Germán García, Matthew Graham, Pablo ... · ~104 visual inspections, 125 SNe Slew 30 s Exposure 87 s Readout 17 s CTIO-La Serena transfer: 120 s La Serena-Santiago

Goals

To facilitate the study of non-moving, variable and transients objects:

● Fast classification of transients, variable stars and active galactic nuclei

● Flexibility to adapt to different science cases (taxonomy, data products)

● Connect survey and follow up resources in Chile and abroad

Page 25: Jorge Vergara , Germán García, Matthew Graham, Pablo ... · ~104 visual inspections, 125 SNe Slew 30 s Exposure 87 s Readout 17 s CTIO-La Serena transfer: 120 s La Serena-Santiago

Scientific Questions

Transients

Progenitors of stellar explosions (outermost layers) & explosion

physics (ejecta structure)

Variable stars

Low mass microlensing events, changing mode stellar pulsators, rapid reaction to eclipsing events, eruptive

events

Active Galactic Nuclei

Changing state AGNs, reverberation mapping studies, detection of

intermediate mass black holes, tidal disruption events

Page 26: Jorge Vergara , Germán García, Matthew Graham, Pablo ... · ~104 visual inspections, 125 SNe Slew 30 s Exposure 87 s Readout 17 s CTIO-La Serena transfer: 120 s La Serena-Santiago

Alert

Real Bogus

Variable

Other

SN Iasubluminous

SN Ia

SN Ib/c

SN IIb SN II

SN IIn

SuperluminousSN

Transient

Other

Tidaldisruption

event

KilonovaSupernova

Gamma ray burst Microlensing

Flare

Novae

Radius/Period

Other

δ Scuti Cepheid

RR Lyrae

Long PeriodVariable

Pulsating

ZZ Ceti

Contact Semi detached/detached

Eclipsing

Periodic

Separation

Other

Stochastic

Cataclysmicvariable

Active GalacticNuclei

AGN Blazar

Young Stellar Object

Included as classIncluded in super class

Not included(@ Nov 2019)

RS CVnOther

c.f. Eyer+19

Page 27: Jorge Vergara , Germán García, Matthew Graham, Pablo ... · ~104 visual inspections, 125 SNe Slew 30 s Exposure 87 s Readout 17 s CTIO-La Serena transfer: 120 s La Serena-Santiago

Science

ALeRCE pipeline:From streaming alerts to science

Alert stream

Crossmatch

Late (LC) classification

Magnitude correction

Featurecomputation

Light curve aggregation

Sync

hro

niza

tio

n

Early (stamp) classification

Rapid follow-up

Outlier detection

Forecasting service

Model parameter estimation

Page 28: Jorge Vergara , Germán García, Matthew Graham, Pablo ... · ~104 visual inspections, 125 SNe Slew 30 s Exposure 87 s Readout 17 s CTIO-La Serena transfer: 120 s La Serena-Santiago

Late ClassifierEarly ClassifierConvolutional Neural Network

(using first stamps)Random Forest Classifier

(using light curve, at least 5 observations)

AGN, SN, VS, asteroid, bogus

QSO-I, AGN-I, Blazar, CV/NovaSN Ia, SN Ibc, SN II, SLSNe

EBSD/D, EBC, DSCT, RRL, Ceph, LPV, Periodic Other

Periodic

Stochastic

Transient

Page 29: Jorge Vergara , Germán García, Matthew Graham, Pablo ... · ~104 visual inspections, 125 SNe Slew 30 s Exposure 87 s Readout 17 s CTIO-La Serena transfer: 120 s La Serena-Santiago

SNe detected by ALeRCE (early classifier)

http://alerce.online/object/ZTF19abvdgqo

Page 30: Jorge Vergara , Germán García, Matthew Graham, Pablo ... · ~104 visual inspections, 125 SNe Slew 30 s Exposure 87 s Readout 17 s CTIO-La Serena transfer: 120 s La Serena-Santiago

SNe detected by ALeRCE (early classifier)

Page 31: Jorge Vergara , Germán García, Matthew Graham, Pablo ... · ~104 visual inspections, 125 SNe Slew 30 s Exposure 87 s Readout 17 s CTIO-La Serena transfer: 120 s La Serena-Santiago

3. DEMOhttp://alerce.science

Page 32: Jorge Vergara , Germán García, Matthew Graham, Pablo ... · ~104 visual inspections, 125 SNe Slew 30 s Exposure 87 s Readout 17 s CTIO-La Serena transfer: 120 s La Serena-Santiago

Web Interfaces

ZTF Explorerhttp://alerce.online

SN Hunterhttp://snhunter.alerce.online

Page 33: Jorge Vergara , Germán García, Matthew Graham, Pablo ... · ~104 visual inspections, 125 SNe Slew 30 s Exposure 87 s Readout 17 s CTIO-La Serena transfer: 120 s La Serena-Santiago

Mobile Phones

Page 34: Jorge Vergara , Germán García, Matthew Graham, Pablo ... · ~104 visual inspections, 125 SNe Slew 30 s Exposure 87 s Readout 17 s CTIO-La Serena transfer: 120 s La Serena-Santiago

Web InterfacesJupyter

Notebooks

TOMs

Output stream(real-time follow-up)

http://alerce.science

API

Page 35: Jorge Vergara , Germán García, Matthew Graham, Pablo ... · ~104 visual inspections, 125 SNe Slew 30 s Exposure 87 s Readout 17 s CTIO-La Serena transfer: 120 s La Serena-Santiago

API

● ZTF Database:http://ztf.alerce.online

● Avro/Stamps: http://avro.alerce.online

● catsHTM Cone Search & Xmatch: http://catshtm.alerce.online *

* Soumagnac & Ofek (2018), (Ofek 2014; ascl.soft 07005)https://alerceapi.readthedocs.io/en/latest/

Page 36: Jorge Vergara , Germán García, Matthew Graham, Pablo ... · ~104 visual inspections, 125 SNe Slew 30 s Exposure 87 s Readout 17 s CTIO-La Serena transfer: 120 s La Serena-Santiago

Jupyter Notebooks

● API

● Transients

● Variable Stars

● Active Galactic Nuclei

https://github.com/alercebroker/usecases

Page 37: Jorge Vergara , Germán García, Matthew Graham, Pablo ... · ~104 visual inspections, 125 SNe Slew 30 s Exposure 87 s Readout 17 s CTIO-La Serena transfer: 120 s La Serena-Santiago

Simple xmatch service

http://xmatch.alerce.online/

Page 38: Jorge Vergara , Germán García, Matthew Graham, Pablo ... · ~104 visual inspections, 125 SNe Slew 30 s Exposure 87 s Readout 17 s CTIO-La Serena transfer: 120 s La Serena-Santiago

Summary

● Future time domain ecosystem: survey & follow up telescopes, brokers and TOMs,

interoperability and diversity for robust and resilient operations

● Tools: image processing, machine learning, scheduling, modeling and inference

● Brokers learning from ZTF to prepare for LSST. Challenges: infrastructure, databases,

classification, visualization, transfer learning, forecasting, outlier detection

● ALeRCE: interdisciplinary research team born from HiTS survey + young developer

team building distributed and scalable system (human capital >> infrastructure).

● Products: living catalog of objects, early and late classifiers, annotated & classified

streams, DB/avro/xmatch APIs, jupyter notebooks

● Large efforts needed to compile training sets to prepare for new paradigm of

machine learning aided astronomy. HSC SSP will play key role for LSST classification!

Page 39: Jorge Vergara , Germán García, Matthew Graham, Pablo ... · ~104 visual inspections, 125 SNe Slew 30 s Exposure 87 s Readout 17 s CTIO-La Serena transfer: 120 s La Serena-Santiago

Happy 20th anniversary!