Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.
Comment: use Code Block macro for SQL to remove links

...

Query

Code Block
languagesql
SELECT o.objID,

...

 
o.raMean, o.decMean, o.raMeanErr, o.decMeanErr,

...


o.qualityFlag,

...


o.gMeanPSFMag, o.gMeanPSFMagErr, o.gMeanPSFMagNpt,

...


o.rMeanPSFMag, o.rMeanPSFMagErr, o.rMeanPSFMagNpt,

...


o.iMeanPSFMag, o.iMeanPSFMagErr, o.iMeanPSFMagNpt,

...


o.zMeanPSFMag, o.zMeanPSFMagErr, o.zMeanPSFMagNpt,

...


o.yMeanPSFMag, o.yMeanPSFMagErr, o.yMeanPSFMagNpt,

...


o.rMeanKronMag, o.rMeanKronMagErr,

...


o.nDetections, o.ng, o.nr, o.ni, o.nz,o.ny,

...


o.gFlags, o.gQfPerfect,

...


o.rFlags, o.rQfPerfect,

...


o.iFlags, o.iQfPerfect,

...


o.zFlags, o.zQfPerfect,

...


o.yFlags, o.yQfPerfect,

...


soa.primaryDetection, soa.bestDetection

...


INTO mydb.[HighFidelityStarsDR2]

...


FROM dbo.fGetNearbyObjEq(334, 0.0, 0.2*60.0) as x

...


JOIN MeanObjectView o on o.ObjID=x.ObjId

...


LEFT JOIN StackObjectAttributes AS soa ON soa.objID = x.objID

...


WHERE o.

...

nDetections>5
AND soa.

...

primaryDetection>0
AND o.

...

gQfPerfect>0.85 and o.

...

rQfPerfect>0.85 and o.

...

iQfPerfect>0.85 and o.

...

zQfPerfect>0.85

...


AND (o.rmeanpsfmag - o.rmeankronmag < 0.05)


Results

696 objects, here are the first 10:

...

The Kepler Extra-Galactic Survey (KEGS) is a program using the Kepler telescope to search for supernovae, active galactic nuclei, and other transients in galaxies. We have to identify galaxies in a suitable redshift range (z<=0.12) a priori, which will be monitored by K2. Here is an example to get galaxies for Campaign 14. We only select objects with r<=19.5, and we make a cut on (rmeanpsfmag - rmeankronmag)>=0.05 in order to remove stars (More info about Star-Galaxy Separation is here). We only want to use objects for which the majority of pixels were not masked, thus the cut on QFperfect>=0.95. We also obtain the petrosian radii in order to be able to select galaxies by size.

Query

...

Code Block
languagesql
SELECT  o.objID,

...


ot.raStack, ot.decStack, ot.raMean, ot.decMean,

...


ot.ng,

...

  o.gMeanPSFMag,o.gMeanPSFMagErr,o.gMeanKronMag,o.gMeanKronMagErr,

...


ot.nr,

...

  o.rMeanPSFMag,o.rMeanPSFMagErr,o.rMeanKronMag,o.rMeanKronMagErr,

...


ot.ni,

...

  o.iMeanPSFMag,o.iMeanPSFMagErr,o.iMeanKronMag,o.iMeanKronMagErr,

...


ot.nz,

...

  o.zMeanPSFMag,o.zMeanPSFMagErr,o.zMeanKronMag,o.zMeanKronMagErr,

...


ot.ny,

...

  o.yMeanPSFMag,o.yMeanPSFMagErr,o.yMeanKronMag,o.yMeanKronMagErr,

...


o.gQfPerfect,o.rQfPerfect,o.iQfPerfect,o.zQfPerfect,o.yQfPerfect,

...


ot.qualityFlag,ot.objInfoFlag,

...


sp.gpetRadius,sp.rpetRadius,sp.ipetRadius,sp.zpetRadius,sp.ypetRadius,

...


sp.gpetR50,sp.rpetR50,sp.ipetR50,sp.zpetR50,sp.ypetR50,

...


soa.primaryDetection, soa.bestDetection

...


       INTO mydb.[C14]

...


FROM MeanObject AS o

...


JOIN fgetNearbyObjEq(160.68333, 6.85167 , 8.5*60.0) cone ON cone.objid = o.objID

...


JOIN ObjectThin AS ot ON ot.objID = o.objID

...


LEFT JOIN StackPetrosian AS sp ON sp.objID = o.objID

...


LEFT JOIN StackObjectAttributes AS soa ON soa.objID = o.objID

...


 WHERE ot.ni >=

...

 3
     AND ot.ng >=

...

 3
     AND ot.nr >=

...

 3
     AND soa.primaryDetection>0
     AND (o.rMeanKronMag > 0 AND o.rMeanKronMag <= 19.5

...

 )
     AND (o.gQfPerfect >= 0.95)

...


     AND (o.rQfPerfect >= 0.95)

...


     AND (o.iQfPerfect >= 0.95)

...


     AND (o.zQfPerfect >= 0.95)

...


     AND (o.rmeanpsfmag - o.rmeankronmag > 0.05)


Results

First 10 out of 161,920 Rows of MyDB Table C14

...

We search for objects in the PS1 DB that are within 3 arcsec of the Catalina positions. Most of the parameters (mean mags, # of detections, etc) we get from the MeanObjectView table. We also join the StackObjectAttributes table in order to get primaryDetection and bestDetection (BestDetection is corrupted in DR2, but will be fixed in DR2.1, see the description of StackObjectThin table for a more detailed description). These RR Lyrae stars are bright, thus we can expect many detections, and we therefore require  o.nDetections>5. We only want to use objects for which the majority of pixels were not masked, thus the cut on QFperfect>=0.95. In order to select only stars (and exclude galaxies), we require (o.rmeanpsfmag - o.rmeankronmag)< 0.05, as described here

Code Block
languagesql
SELECT d.CSS_ID, d.RA as CSSRA, d.Dec as CSSDec, d.V, d.Period, d.Amp, d.Npts, d.Dist, d.Red, d.CSIDnum,

...


o.objID,

...

  
o.raMean, o.decMean, o.raMeanErr, o.decMeanErr,

...

 
o.qualityFlag,

...


o.gMeanPSFMag, o.gMeanPSFMagErr, o.gMeanPSFMagNpt,

...


o.rMeanPSFMag, o.rMeanPSFMagErr, o.rMeanPSFMagNpt,

...


o.iMeanPSFMag, o.iMeanPSFMagErr, o.iMeanPSFMagNpt,

...


o.zMeanPSFMag, o.zMeanPSFMagErr, o.zMeanPSFMagNpt,

...


o.yMeanPSFMag, o.yMeanPSFMagErr, o.yMeanPSFMagNpt,

...

 
o.rMeanKronMag, o.rMeanKronMagErr,

...


o.nDetections, o.ng, o.nr, o.ni, o.nz,o.ny,

...


o.gFlags, o.gQfPerfect,

...


o.rFlags, o.rQfPerfect,

...


o.iFlags, o.iQfPerfect,

...


o.zFlags, o.zQfPerfect,

...


o.yFlags, o.yQfPerfect,

...


soa.primaryDetection, soa.bestDetection

...


 INTO mydb.[RRLPS1]

...


 FROM mydb.[RRLcatalina] d

...


CROSS APPLY dbo.fGetNearbyObjEq(d.RA, d.Dec, 3.0/60.0) as x

...


JOIN MeanObjectView o on o.ObjID=x.ObjId

...


LEFT JOIN StackObjectAttributes AS soa ON soa.objID = x.objID

...


WHERE o.

...

nDetections>5 
AND soa.primaryDetection>0 
AND o.gQfPerfect>0.85 and o.rQfPerfect>0.85 and o.iQfPerfect>0.85 and o.zQfPerfect>0.85 
AND (o.rmeanpsfmag - o.rmeankronmag < 0.05)


Results (25 minutes)

There are 12 out of 13 matches, and below are the first 10 entries

...

Now we get all detections associated with these objIDs

Code Block
languagesql
SELECT

...


o.objID, o.raMean, o.decMean,

...


d.ra, d.dec, d.raErr, d.decErr,

...

 
d.detectID, d.obstime, d.exptime, d.airmass, d.psfflux, d.psffluxErr, d.psfQf, d.psfQfPerfect, d.psfLikelihood, d.psfChiSq, d.extNSigma, d.zp, d.apFlux, d.apFluxErr,

...


d.imageID, d.filterID,

...


d.sky, d.skyerr, d.infoflag, d.infoflag2, d.infoflag3,

...


o.qualityFlag,

...


o.gMeanPSFMag, o.gMeanPSFMagErr, o.gMeanPSFMagNpt,

...


o.rMeanPSFMag, o.rMeanPSFMagErr, o.rMeanPSFMagNpt,

...


o.iMeanPSFMag, o.iMeanPSFMagErr, o.iMeanPSFMagNpt,

...


o.zMeanPSFMag, o.zMeanPSFMagErr, o.zMeanPSFMagNpt,

...


o.yMeanPSFMag, o.yMeanPSFMagErr, o.yMeanPSFMagNpt,

...

 
o.rMeanKronMag, o.rMeanKronMagErr,

...


o.nDetections, o.ng, o.nr, o.ni, o.nz,o.ny,

...


o.gFlags, o.gQfPerfect,

...


o.rFlags, o.rQfPerfect,

...


o.iFlags, o.iQfPerfect,

...


o.zFlags, o.zQfPerfect,

...


o.yFlags, o.yQfPerfect,

...


o.primaryDetection, o.bestDetection

...


 INTO mydb.[RRLPS1det]

...


 FROM mydb.[RRLPS1] o

...


JOIN Detection d on d.ObjID = o.ObjID


Results (30 seconds)

There are 946 detection entries for the 12 objects, and below are the first 10 entries

...

Now we get the forced photometry

...

Code Block
languagesql
SELECT
o.objID, o.raMean, o.decMean,

...


fwm.detectID, fwm.obstime, fwm.exptime, fwm.airmass, fwm.Fpsfflux, fwm.FpsffluxErr, fwm.FpsfQf, fwm.FpsfQfPerfect, fwm.FpsfChiSq, fwm.zp, fwm.FapFlux, fwm.FapFluxErr,

...


fwm.forcedWarpID, fwm.filterID,

...


fwm.Fsky, fwm.Fskyerr, fwm.Finfoflag, fwm.Finfoflag2, fwm.Finfoflag3,

...


o.qualityFlag,

...


o.gMeanPSFMag, o.gMeanPSFMagErr, o.gMeanPSFMagNpt,

...


o.rMeanPSFMag, o.rMeanPSFMagErr, o.rMeanPSFMagNpt,

...


o.iMeanPSFMag, o.iMeanPSFMagErr, o.iMeanPSFMagNpt,

...


o.zMeanPSFMag, o.zMeanPSFMagErr, o.zMeanPSFMagNpt,

...


o.yMeanPSFMag, o.yMeanPSFMagErr, o.yMeanPSFMagNpt,

...

 
o.rMeanKronMag, o.rMeanKronMagErr,

...


o.nDetections, o.ng, o.nr, o.ni, o.nz,o.ny,

...


o.gFlags, o.gQfPerfect,

...


o.rFlags, o.rQfPerfect,

...


o.iFlags, o.iQfPerfect,

...


o.zFlags, o.zQfPerfect,

...


o.yFlags, o.yQfPerfect,

...


o.primaryDetection, o.bestDetection

...


 INTO mydb.[RRLPS1forceddet]

...


 FROM mydb.[RRLPS1] o

...


JOIN ForcedWarpMeasurement fwm on fwm.ObjID = o.ObjID


Results (3:45 minutes)

There are 824 forced detection entries for the 12 objects, and below are the first 10 entries

...

Query #1: Get the ObjID for the star

Code Block

...

languagesql
SELECT 
o.objID,

...

  
o.raMean, o.decMean, o.raMeanErr, o.decMeanErr,

...

 
o.qualityFlag,

...


o.gMeanPSFMag, o.gMeanPSFMagErr, o.gMeanPSFMagNpt,

...


o.rMeanPSFMag, o.rMeanPSFMagErr, o.rMeanPSFMagNpt,

...


o.iMeanPSFMag, o.iMeanPSFMagErr, o.iMeanPSFMagNpt,

...


o.zMeanPSFMag, o.zMeanPSFMagErr, o.zMeanPSFMagNpt,

...


o.yMeanPSFMag, o.yMeanPSFMagErr, o.yMeanPSFMagNpt,

...

 
o.rMeanKronMag, o.rMeanKronMagErr,

...


o.nDetections, o.ng, o.nr, o.ni, o.nz,o.ny,

...


o.gFlags, o.gQfPerfect,

...


o.rFlags, o.rQfPerfect,

...


o.iFlags, o.iQfPerfect,

...


o.zFlags, o.zQfPerfect,

...


o.yFlags, o.yQfPerfect

...


 INTO mydb.[RRL_584630948352256_PS1]

...


FROM dbo.fGetNearbyObjEq(46.341468915923, 1.54199810825252, 1.0/60.0) as x

...


JOIN MeanObjectView o on o.ObjID=x.ObjId


Results (1 entry, < 1 min)

...

Query #2: Get the detections

Code Block
languagesql
SELECT

...

 
o.objID, o.raMean, o.decMean,

...


d.ra, d.dec, d.raErr, d.decErr,

...

 
d.detectID,
 d.obstime, d.exptime, d.airmass, d.psfflux, d.psffluxErr, d.psfQf, 
d.psfQfPerfect, d.psfLikelihood, d.psfChiSq, d.extNSigma, d.zp, 
d.apFlux, d.apFluxErr,

...


d.imageID, d.filterID,

...


d.sky, d.skyerr, d.infoflag, d.infoflag2, d.infoflag3,

...


o.qualityFlag,

...


o.gMeanPSFMag, o.gMeanPSFMagErr, o.gMeanPSFMagNpt,

...


o.rMeanPSFMag, o.rMeanPSFMagErr, o.rMeanPSFMagNpt,

...


o.iMeanPSFMag, o.iMeanPSFMagErr, o.iMeanPSFMagNpt,

...


o.zMeanPSFMag, o.zMeanPSFMagErr, o.zMeanPSFMagNpt,

...


o.yMeanPSFMag, o.yMeanPSFMagErr, o.yMeanPSFMagNpt,

...

 
o.rMeanKronMag, o.rMeanKronMagErr,

...


o.nDetections, o.ng, o.nr, o.ni, o.nz,o.ny,

...


o.gFlags, o.gQfPerfect,

...


o.rFlags, o.rQfPerfect,

...


o.iFlags, o.iQfPerfect,

...


o.zFlags, o.zQfPerfect,

...


o.yFlags, o.yQfPerfect

...


 INTO mydb.[RRL_584630948352256_PS1det]

...


 FROM mydb.[RRL_584630948352256_PS1] o

...


JOIN Detection d on d.ObjID = o.ObjID


Results (92 entries, < 1 min)

...

Query #3: Get the forced detections

Code Block
languagesql
SELECT

...


o.objID, o.raMean, o.decMean,

...


fwm.detectID,
 fwm.obstime, fwm.exptime, fwm.airmass, fwm.Fpsfflux, fwm.FpsffluxErr, 
fwm.FpsfQf, fwm.FpsfQfPerfect, fwm.FpsfChiSq, fwm.zp, fwm.FapFlux, 
fwm.FapFluxErr,

...


fwm.forcedWarpID, fwm.filterID,

...


fwm.Fsky, fwm.Fskyerr, fwm.Finfoflag, fwm.Finfoflag2, fwm.Finfoflag3,

...


o.qualityFlag,

...


o.gMeanPSFMag, o.gMeanPSFMagErr, o.gMeanPSFMagNpt,

...


o.rMeanPSFMag, o.rMeanPSFMagErr, o.rMeanPSFMagNpt,

...


o.iMeanPSFMag, o.iMeanPSFMagErr, o.iMeanPSFMagNpt,

...


o.zMeanPSFMag, o.zMeanPSFMagErr, o.zMeanPSFMagNpt,

...


o.yMeanPSFMag, o.yMeanPSFMagErr, o.yMeanPSFMagNpt,

...


o.rMeanKronMag, o.rMeanKronMagErr,

...


o.nDetections, o.ng, o.nr, o.ni, o.nz,o.ny,

...


o.gFlags, o.gQfPerfect,

...


o.rFlags, o.rQfPerfect,

...


o.iFlags, o.iQfPerfect,

...


o.zFlags, o.zQfPerfect,

...


o.yFlags, o.yQfPerfect

...


INTO mydb.[RRL__584630948352256_PS1forceddet]

...

 
FROM mydb.[RRL_584630948352256_PS1] o

...


JOIN ForcedWarpMeasurement fwm on fwm.ObjID = o.ObjID


Results (84 entries, <1 min)

...

We start with a cone search of ObjectThin within a 3 degree radius of the nominal HDF position (169.2,61.3).  We select only mean objects with at least three detections and mean PSF magnitude r < 21.0 (Gaia sources are sparse at fainter magnitudes).  The following search was run in CasJobs and took 8:29, returning 192,611 objects.

Code Block
languagesql
select o.objID, o.raMean, o.decMean, o.raMeanErr, o.decMeanErr,

...

 
   o.raStack, o.decStack, o.raStackErr, o.decStackErr, o.epochMean,

...

 
   o.nDetections, o.ng, o.nr, o.ni, o.nz, o.ny, o.objInfoFlag, o.qualityFlag,

...


   m.gMeanPSFMag, m.rMeanPSFMag, m.iMeanPSFMag, m.zMeanPSFMag, m.yMeanPSFMag,

...


   m.gMeanPSFMagErr, m.rMeanPSFMagErr, m.iMeanPSFMagErr, m.zMeanPSFMagErr, m.yMeanPSFMagErr,

...


   m.gMeanKronMag, m.rMeanKronMag, m.iMeanKronMag, m.zMeanKronMag, m.yMeanKronMag,

...


   m.gFlags, m.rFlags, m.iFlags, m.zFlags, m.yFlags

...

 
   into mydb.MyTable_HDF_3deg_extended from fGetNearbyObjEq(169.20,62.30,180.0) nb

...


inner join ObjectThin o on o.objid=nb.objid and o.

...

nDetections>3
inner join MeanObject m on o.objid=m.objid and o.uniquePspsOBid=m.uniquePspsOBid and m.

...

rMeanPSFMag<21.0


The output table is 48,200 kb; here is a sample of the first few rows:

...

The following query identifies all detections associated (i.e., having the same ObjID) as the mean objects obtained in Step 1, and extracts relevant parameters for each.  The query ran for 3:18 and returned 8,560,632 rows (detections), or an average of over 40 per mean object. 

Code Block
languagesql
select d.detectID, d.objid, d.obstime, d.exptime, d.airmass, d.psfflux, d.psffluxErr, d.psfQF,

...


d.imageID, d.filterID, d.sky, d.skyerr, d.infoflag, d.infoflag2, d.infoflag3, d.ra, d.dec, d.raerr, d.decerr

...

 
into mydb.MyTable_HDF_det2

...


from Detection d

...


inner join MyDB.MyTable_HDF_3deg mm on d.objid=mm.objid


The resulting table is about 1.3 GB, exceeding the standard limit in CasJobs.  A sample of the first several rows follows.

...