Python widgets for astronomy visualization

(1)

Python widgets

for astronomy

visualization

David Shupe (Caltech/IPAC) Scientist, LSST and ZTF

on behalf of the LSST

Science User Interface & Tools team

(2)

Astronomy in 2020+

Context: LSST Science Platform

Too much data to download -> Remote workspaces

LSST LSST Stack

DAX and Compu3ng Infrastructure Fireﬂy

Query/Visualize: xyz Analyze: xyz

Data: xyz

LSST LSST Stack

Data Access, Database and Compu6ng Infrastructure Fireﬂy

(3)

(4)

Python widgets for astronomy visualization

• The Firefly visualization system

(5)

Python widgets for astronomy visualization

(6)

Python widgets for astronomy visualization

• APIs to Firefly

(7)

Python widgets for astronomy visualization

• APIs to Firefly

• Example: Python interaction with the Firefly app • Firefly widgets for Jupyter

(8)

Python widgets for astronomy visualization

• APIs to Firefly

(9)

Python widgets for astronomy visualization

• APIs to Firefly

(10)

Archive Access System

Firefly

(11)

Firefly

Pipeline

Database

Disk/Tape

Store

(12)

Firefly

Pipeline

Database

Disk/Tape

Store

Search

Retrieval

System

Workspace

(13)

Firefly

Pipeline

Database

Disk/Tape

Store

Search

Retrieval

System

Workspace

Firefly

Server

Firefly

Web

Client

(14)

Table Display

FITS Image

 

Viewer

(15)

Table Display

FITS Image

 

Viewer

• WCS Readout

• Zoom

• Flip/ Rotate/ Crop

• Color / Stretch • Grid • Region • Magnifier • Distance tools • Markers • Fits Headers • Crop

XY Plot / Histogram

(16)

Table Display

FITS Image

 

Viewer

• WCS Readout

• Zoom

• Color / Stretch • Grid • Region • Magnifier • Distance tools • Markers • Fits Headers • Crop • Sort / Filter • Column Controls

• Supports large tables, 1O Million+ rows

• Very fast response time

(17)

Table Display

FITS Image

 

Viewer

• WCS Readout

• Zoom

• Color / Stretch • Grid • Region • Magnifier • Distance tools • Markers • Fits Headers • Crop • Sort / Filter • Column Controls

• Supports large tables, 1O Million+ rows

• Very fast response time

• Interactive

• Column math

• Zoom

• Filter

(18)

Many Faces

of Firefly

(19)

Catalog Search

Planck

WISE

Spitzer

IRSA Viewer

Finder Chart

Herschel

Many Faces

of Firefly

(20)

(21)

Using Firefly

• Servers

• Application at Infrared Science Archive 

http://irsa.ipac.caltech.edu/irsaviewer

• Standalone Firefly  

(22)

Using Firefly

• Servers

• Application at Infrared Science Archive 

http://irsa.ipac.caltech.edu/irsaviewer

• Standalone Firefly  

Download a single file, deploy using only Java 8

• Programmatic interfaces • Javascript

• Python with Firefly the single-page application • Widgets for Jupyter notebook / JupyterLab

(23)

Python widgets for astronomy visualization

• APIs to Firefly • Javascript

• Python: firefly_client

(24)

Contemporar y JavaScript framework

External and internal actions are enabled

Actions Reducers Store View Dispatch Subscribe Actions dispatched from outside Actions monitored by the outside Control Response

(25)

Javascript API falls out naturally

• Dispatch actions to make a change 

var action= firefly.action; • To change color:  action.dispatchColorChange({plotId:’myplot’,   cbarId:5}); • Zooming an image:  action.dispatchZoom({plotId:’myplot’,   userZoomType:’UP’ });    action.dispatchZoom({plotId:’myplot’,  userZoomType:’LEVEL’,level: zlevel,   forceDelay: true });

(26)

Documentation for Javascript API

(27)

Python API tracks Javascript closely

• firefly_client is a thin layer over Javascript API

• Pip-installable

• Dispatch actions, add listeners (callbacks) • Image display for a local Firefly server: 

import firefly_client    fc = firefly_client.FireflyClient(‘localhost:8080’)    fval = fc.upload_file(‘myfile.fits’)    fc.show_fits(fval)

(28)

Python widgets for astronomy visualization

• APIs to Firefly

(29)

Setup with Jupyter notebook

Forced photometry with LSST stack

• Define function for

forced photometry for (ra, dec, filter)

• Callback listens for row

selection and point events

• Extension added to

Firefly to enable this button in point

(30)

Add-on from Python: photometry on click

(31)

Add-on from Python: photometry on click

(32)

Table of results is returned to the browser

(33)

Table of results is returned to the browser

(34)

Python widgets for astronomy visualization

• APIs to Firefly

(35)

Eventful Python objects that have a representation in the browser

What are widgets?

(36)

What are widgets?

(37)

What are widgets?

(38)

What are widgets?

(39)

Firefly Widgets

• Available as

firefly_widgets

• Interactive widgets for

Images and Tables

• Widgets currently just past

experimental state

(40)

Firefly Widgets

• Available as

firefly_widgets

• Interactive widgets for

Images and Tables

• Widgets currently just past

experimental state

(41)

Interactive Table Widget

(42)

Interactive Table Widget

(43)

Synchronize widget properties with other widgets

(44)

Synchronize widget properties with other widgets

(45)

(46)

Lessons learned from widget development

• Use the cookiecutter template for Jupyter widgets • incorporates best practices for packaging

(47)

Lessons learned from widget development

• makes installation straightforward • Development is light on Python side, 

(48)

Lessons learned from widget development

• makes installation straightforward • Development is light on Python side, 

heavy on Javascript

• Only some actions are good candidates for widget attributes • If action is done on the client — can change quickly

(49)

Python widgets for astronomy visualization

• APIs to Firefly

(50)

(51)

Resources for Firefly

(52)

Resources for Firefly

• Instructional videos at IRSA IPAC channel on YouTube • Source code repositories with example notebooks 

(53)

Resources for Firefly

firefly, firefly_client, firefly_widgets

(54)

Resources for Firefly

• Documentation for Javascript and Python APIs

(55)

Resources for Firefly

• Documentation for Javascript and Python APIs

• Demo videos made for the Large Synoptic Survey telescope • See blog post at astropython.wordpress.com for links