Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Introduced a new arguement --skymap-only-ifos in pycbc_live #4346

Merged
merged 11 commits into from
Jul 11, 2023

Conversation

SouradeepPal
Copy link
Contributor

@SouradeepPal SouradeepPal commented May 3, 2023

A new argument --skymap-only-ifos for pycbc_live that accepts a list of IFOs to be used in skymap-only followup. These ifos should now be skipped during the regular matched-filtering, coincidence making, background estimation..

@titodalcanton
Copy link
Contributor

Thanks @SouradeepPal. It looks like this is making the PyCBC Live test fail. Could you have a look?

bin/pycbc_live Outdated
"""Figure out which of the followup detectors are usable, and compute
SNR time series for all the available detectors.
"""
out = {}
followup_ifos = [] if followup_ifos is None else followup_ifos
skymap_only_ifos = [] if skymap_only_ifos is None else skymap_only_ifos
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Can you set the default value in kwargs to be [], and then you don't have this bit?

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

No, that is not a good idea. What @SouradeepPal did initially is the recommended approach.

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

bin/pycbc_live Outdated Show resolved Hide resolved
bin/pycbc_live Outdated
@@ -910,6 +925,8 @@ parser.add_argument('--enable-embright-has-massgap', action='store_true', defaul
parser.add_argument('--embright-massgap-max', type=float, default=5.0, metavar='SOLAR MASSES',
help='Upper limit of the mass gap, used for estimating '
'HasMassGap probability.')
parser.add_argument('--skymap-only-ifos', nargs='+', default=['V1', 'K1'],
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Small problem here that there is no way that I can see to set none of the ifos to be skymap-only. I would set the default to be [].

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Hi Gareth, all the changes you suggested have been made.

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks! I'll let @titodalcanton hit the approve button, in case there was anything else I missed

bin/pycbc_live Outdated
Comment on lines 916 to 917
parser.add_argument('--skymap-only-ifos', nargs='+', default=[],
help="IFOs that only contribute in sky localization")
Copy link
Contributor

@titodalcanton titodalcanton May 4, 2023

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Do not set defaults here. Also, replace "IFOs" with "detectors" in the help string.

bin/pycbc_live Outdated
@@ -1100,7 +1108,7 @@ with ctx:
args.max_psd_abort_distance)
status = False

if status is True:
if ifo not in skymap_only_ifos and status is True:
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This logic is not really what we want, because it will print "Insufficient data for %s analysis" even if a detector is a skymap-only detector.

bin/pycbc_live Outdated

# Check for singles
if args.enable_single_detector_background:
evnt.check_singles(results, psds)
evnt.check_singles(results, psds, skymap_only_ifos=skymap_only_ifos)
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think you can simplify the code if you set skymap_only_ifos to be an attribute of the LiveEventManager class. Then you do not need to carry around all these arguments.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This is what I had initially thought, but dropped the idea seeeing that ifos is not an attribute of the LiveEventManager. Is there a reason. Now I have added skymap_only_ifos as an attribute which seems to have simplified things. But the test failed which I cannot understand atm. Where should I look at to debug.

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The test failure seems to be a condor installation issue - I will click to restart failed tests in case this was a transient thing, but we may need a fix elsewhere if it isnt

@GarethCabournDavies
Copy link
Contributor

I think this is okay to merge now - @titodalcanton do you agree?

@titodalcanton
Copy link
Contributor

No, I would like to see at least a minimal proof that this works correctly before merging.

@GarethCabournDavies
Copy link
Contributor

Okay - @SouradeepPal can you provide an example of this running? You should be able to modify the example in examples/live/run.sh to use V1 as a skymap-only detector

@SouradeepPal
Copy link
Contributor Author

I am retrying but last time I had to stop here: https://git.ligo.org/pycbc/action-items/-/issues/23#note_712046

@SouradeepPal
Copy link
Contributor Author

Hi, some changes have been made in pycbc_live and pycbc/io/live.py. This mostly produces skymaps that are identical to the HLV and HLv configurations for example:
lHLV_rHLv

But there are two of them each with same coinc_times:
HLV:
HLV2
HLv:
HLv2
If one of them is an SNR optimized skymap, then HLv can be skipping it..

Other skymaps with singles look okay from both HLV and HLv or where there is a LV coinc in HLV ..

@spxiwh
Copy link
Contributor

spxiwh commented Jun 27, 2023

@SouradeepPal Checking I've understood: The second row of plots are both from the standard HLV analyses, and we think that one of these is the SNR optimized event?

The third row is from the new HLv analyses, again we think that one of these is SNR optimized, but worry it may not have used V? Can you point me to the trigger directory for both triggers in the bottom row?

@SouradeepPal
Copy link
Contributor Author

SouradeepPal commented Jun 27, 2023

Yes, that is what I am guessing. Triggers for HLv are in Caltech, here : /home/souradeep.pal/pycbc/examples/live/output_HLv/2020_05_06/candidate_1272790260.113_xagp and /home/souradeep.pal/pycbc/examples/live/output_HLv/2020_05_06/candidate_1272790260.113_bglu. I noticed that the later actually contains a single. Please let me know if you can access these.

@spxiwh
Copy link
Contributor

spxiwh commented Jun 27, 2023

Okay, it seems that one of these triggers is a H1 single, which included L1 as a "followup detector" and a H1L1 double, which included V1 as a followup detector. So question is, why did the singles analysis not include V1.

The optimize_snr is done in a subdirectory (of the H1L1 double trigger) called optimize_snr. This seems to have failed, but I'm not sure why. We should understand why this failure occurred (unless it's a random weird one-off thing) as well as fixing the single.

@SouradeepPal
Copy link
Contributor Author

Thanks, HLv skymaps now:
HLv2new

which is now identical to the HLV case.

The optimize_snr has a log file:

  File "/home/souradeep.pal/.conda/envs/pycbc-live-dev/bin/pycbc_optimize_snr", line 351, in <module>
    opt_params = optimize_func(bounds, args, extra_args)
  File "/home/souradeep.pal/.conda/envs/pycbc-live-dev/bin/pycbc_optimize_snr", line 133, in optimize_di
    results = differential_evolution(
  File "/home/souradeep.pal/.conda/envs/pycbc-live-dev/lib/python3.9/site-packages/scipy/optimize/_differentialevolution.py", line 329, in differential_evolution
    ret = solver.solve()
  File "/home/souradeep.pal/.conda/envs/pycbc-live-dev/lib/python3.9/site-packages/scipy/optimize/_differentialevolution.py", line 903, in solve
    result = minimize(self.func,
  File "/home/souradeep.pal/.conda/envs/pycbc-live-dev/lib/python3.9/site-packages/scipy/optimize/_minimize.py", line 692, in minimize
    res = _minimize_lbfgsb(fun, x0, args, jac, bounds,
  File "/home/souradeep.pal/.conda/envs/pycbc-live-dev/lib/python3.9/site-packages/scipy/optimize/_lbfgsb_py.py", line 296, in _minimize_lbfgsb
    raise ValueError("LBFGSB - one of the lower bounds is greater than an upper bound.")
ValueError: LBFGSB - one of the lower bounds is greater than an upper bound.

Interestingly, the same error log is also present in one of the HLV triggers.. while another HLV trigger seems to have successfully run the optimized thing.. /home/souradeep.pal/pycbc/examples/live/output_HLV/2020_05_06 The error log also seems to be related to some other thing..

@spxiwh
Copy link
Contributor

spxiwh commented Jun 27, 2023

I would like to be sure the the optimize_snr failure is not caused by this patch. Is it possible to try running the example (HLV) with this patch not applied, and see if we can get the same failure?

@SouradeepPal
Copy link
Contributor Author

SouradeepPal commented Jun 27, 2023

A fresh install of the main branch already has the following:

>> [Tue Jun 27 05:47:50 PDT 2023] Showing log of SNR optimizer, output/2020_05_06/candidate_1272790100.164_aimn/optimize_snr/optimize_snr.log
2023-06-27T05:41:51.775-07:00 Running with CPU support: 1 threads
2023-06-27T05:41:51.775-07:00 Starting optimize SNR
2023-06-27T05:41:51.789-07:00 Starting optimization
XLAL Error - XLALSimIMRSEOBNRv4ROMTimeOfFrequency (LALSimIMRSEOBNRv4ROM.c:1491): Frequency 25.5 Hz (Mf=0.0586826) is outside allowed range.
Min / max / final Mf values are 9.85e-05, 0.3, 0.0566956

XLAL Error - XLALSimIMRSEOBNRv4ROMTimeOfFrequency (LALSimIMRSEOBNRv4ROM.c:1491): Input domain error
XLAL Error - XLALSimIMRSEOBNRv4ROMTimeOfFrequency (LALSimIMRSEOBNRv4ROM.c:1491): Frequency 25.5 Hz (Mf=0.061013) is outside allowed range.
Min / max / final Mf values are 9.85e-05, 0.3, 0.0602515

XLAL Error - XLALSimIMRSEOBNRv4ROMTimeOfFrequency (LALSimIMRSEOBNRv4ROM.c:1491): Input domain error
XLAL Error - XLALSimIMRSEOBNRv4ROMTimeOfFrequency (LALSimIMRSEOBNRv4ROM.c:1491): Frequency 25.5 Hz (Mf=0.0613795) is outside allowed range.
Min / max / final Mf values are 9.85e-05, 0.3, 0.0593014

XLAL Error - XLALSimIMRSEOBNRv4ROMTimeOfFrequency (LALSimIMRSEOBNRv4ROM.c:1491): Input domain error
XLAL Error - XLALSimIMRSEOBNRv4ROMTimeOfFrequency (LALSimIMRSEOBNRv4ROM.c:1491): Frequency 25.5 Hz (Mf=0.0611347) is outsi..

@spxiwh
Copy link
Contributor

spxiwh commented Jun 27, 2023

The XLAL Errors are just warnings in this case, you should be able to see some form of output from the code in this case??

@SouradeepPal
Copy link
Contributor Author

No, all these got dumped in the log file, no other files were generated

@spxiwh
Copy link
Contributor

spxiwh commented Jun 27, 2023

Where is this new directory, so I can check the log?

@SouradeepPal
Copy link
Contributor Author

Here: /home/souradeep.pal/dump/pycbc_new/examples/live/output/2020_05_06/candidate_1272790100.164_aimn

@spxiwh
Copy link
Contributor

spxiwh commented Jun 27, 2023

Okay, that directory looks like optimize_snr was working, but I think it was terminated because it just took too much time.

@SouradeepPal
Copy link
Contributor Author

Ok , timeout also happened:

2023-06-27T06:47:22.685-07:00 ldas-pcdev4 0 Generating SPAtmplt, 384.0s, 26, starting from 27.0 Hz
2023-06-27T06:47:22.824-07:00 ldas-pcdev4 0 running timeout 400 /home/souradeep.pal/.conda/envs/pycbc-live-dev/bin/pycbc_optimize_snr --data-files H1:output/2020_05_06/candidate_1272790260.113_zqdh/coinc-1272790260.113_H1_data_overwhitened.hdf L1:output/2020_05_06/candidate_1272790260.113_zqdh/coinc-1272790260.113_L1_data_overwhitened.hdf V1:output/2020_05_06/candidate_1272790260.113_zqdh/coinc-1272790260.113_V1_data_overwhitened.hdf --psd-files H1:output/2020_05_06/candidate_1272790260.113_zqdh/coinc-1272790260.113_H1_psd.hdf L1:output/2020_05_06/candidate_1272790260.113_zqdh/coinc-1272790260.113_L1_psd.hdf V1:output/2020_05_06/candidate_1272790260.113_zqdh/coinc-1272790260.113_V1_psd.hdf --params-file output/2020_05_06/candidate_1272790260.113_zqdh/coinc-1272790260.113_attributes.hdf --approximant SPAtmplt --gracedb-server None --gracedb-search AllSky --gracedb-labels SNR_OPTIMIZED --verbose --output-path output/2020_05_06/candidate_1272790260.113_zqdh/optimize_snr --cores 1 --processing-scheme cpu:1  with log to output/2020_05_06/candidate_1272790260.113_zqdh/optimize_snr/optimize_snr.log
2023-06-27T06:47:23.061-07:00 ldas-pcdev4 0 Adding V1 to candidate, pvalue 0.49454809789193116, 4126 samples

But for that the log file looks different: /home/souradeep.pal/pycbc/examples/live/output/2020_05_06/candidate_1272790260.113_zqdh/optimize_snr (but for HLv)

@spxiwh
Copy link
Contributor

spxiwh commented Jun 27, 2023

Well /home/souradeep.pal/pycbc/examples/live/output/2020_05_06/candidate_1272790260.113_zqdh looks like it failed, and seems to have evolved quite differently from:

/home/souradeep.pal/dump/pycbc_new/examples/live/output/2020_05_06/candidate_1272790100.164_aimn

However, the times are different, so it feels like I'm not comparing like-for-like here(??)

@SouradeepPal
Copy link
Contributor Author

A few more tries without this patch applied (or on the commit above) seem to not fail like that with the patch applied (but have other XLAL Error and timeouts).. So I wanted to understand what might be causing it, here it seems that the process starts, continues for ~ 2min and then fails due to something- so likely not that any missing/misbehaving input file? (I am again pasting the complete log for 1272790260 here at /home/souradeep.pal/pycbc/examples/live/output_HLV/2020_05_06/candidate_1272790260.106_pwkj/optimize_snr)

2023-06-25T23:18:28.686-07:00 Running with CPU support: 1 threads
2023-06-25T23:18:30.363-07:00 Starting optimize SNR
2023-06-25T23:18:30.396-07:00 Starting optimization
2023-06-25T23:18:30.590-07:00 Currently at 0 0.0
2023-06-25T23:18:30.741-07:00 Currently at 1 0.0
2023-06-25T23:18:30.900-07:00 Currently at 2 0.0
2023-06-25T23:18:31.027-07:00 Currently at 3 0.0
2023-06-25T23:18:31.210-07:00 Currently at 4 0.0
2023-06-25T23:18:31.446-07:00 Currently at 5 0.0
2023-06-25T23:18:31.664-07:00 Currently at 6 0.0
2023-06-25T23:18:31.938-07:00 Currently at 7 0.0
2023-06-25T23:18:32.250-07:00 Currently at 8 0.0
2023-06-25T23:18:32.634-07:00 Currently at 9 0.0
2023-06-25T23:18:33.169-07:00 Currently at 10 0.0
2023-06-25T23:18:33.779-07:00 Currently at 11 0.0
2023-06-25T23:18:34.593-07:00 Currently at 12 0.0
2023-06-25T23:18:35.707-07:00 Currently at 13 0.0
2023-06-25T23:18:37.226-07:00 Currently at 14 0.0
2023-06-25T23:18:39.160-07:00 Currently at 15 0.0
2023-06-25T23:18:41.566-07:00 Currently at 16 0.0
2023-06-25T23:18:43.681-07:00 Currently at 17 0.0
2023-06-25T23:18:45.647-07:00 Currently at 18 0.0
2023-06-25T23:18:48.511-07:00 Currently at 19 0.0
2023-06-25T23:18:51.607-07:00 Currently at 20 0.0
2023-06-25T23:18:54.406-07:00 Currently at 21 0.0
2023-06-25T23:18:57.274-07:00 Currently at 22 0.12369231656981065
2023-06-25T23:19:00.154-07:00 Currently at 23 0.12158622441614034
2023-06-25T23:19:03.603-07:00 Currently at 24 0.12579705866462773
2023-06-25T23:19:06.906-07:00 Currently at 25 0.1276872044443044
2023-06-25T23:19:10.011-07:00 Currently at 26 0.12161535414374221
2023-06-25T23:19:12.753-07:00 Currently at 27 0.12120462574336378
2023-06-25T23:19:15.714-07:00 Currently at 28 0.11954771776250084
2023-06-25T23:19:19.262-07:00 Currently at 29 0.11552664213923491
2023-06-25T23:19:22.230-07:00 Currently at 30 0.11528027571920592
2023-06-25T23:19:25.223-07:00 Currently at 31 0.11576148588313943
2023-06-25T23:19:28.178-07:00 Currently at 32 0.11615297295499952
2023-06-25T23:19:31.552-07:00 Currently at 33 0.10980472141997731
2023-06-25T23:19:35.004-07:00 Currently at 34 0.10918058644014089
2023-06-25T23:19:38.167-07:00 Currently at 35 0.10951318911761426
2023-06-25T23:19:41.177-07:00 Currently at 36 0.10991558238299652
2023-06-25T23:19:44.521-07:00 Currently at 37 0.10935057623251014
2023-06-25T23:19:48.182-07:00 Currently at 38 0.11175375326354606
2023-06-25T23:19:51.273-07:00 Currently at 39 0.10937568390898102
2023-06-25T23:19:54.937-07:00 Currently at 40 0.1046167384450629
2023-06-25T23:19:58.868-07:00 Currently at 41 0.10293193408911076
2023-06-25T23:20:02.090-07:00 Currently at 42 0.10397934569719869
2023-06-25T23:20:05.029-07:00 Currently at 43 0.10542646896213599
2023-06-25T23:20:08.264-07:00 Currently at 44 0.10676131040337074
2023-06-25T23:20:11.990-07:00 Currently at 45 0.10741358539407901
2023-06-25T23:20:15.553-07:00 Currently at 46 0.10714211281577206
2023-06-25T23:20:18.890-07:00 Currently at 47 0.10949187235934509
2023-06-25T23:20:22.356-07:00 Currently at 48 0.11203763171188066
2023-06-25T23:20:26.088-07:00 Currently at 49 0.11555929608029122
Traceback (most recent call last):
  File "/home/souradeep.pal/.conda/envs/pycbc-live-dev/bin/pycbc_optimize_snr", line 351, in <module>
    opt_params = optimize_func(bounds, args, extra_args)
  File "/home/souradeep.pal/.conda/envs/pycbc-live-dev/bin/pycbc_optimize_snr", line 133, in optimize_di
    results = differential_evolution(
  File "/home/souradeep.pal/.conda/envs/pycbc-live-dev/lib/python3.9/site-packages/scipy/optimize/_differentialevolution.py", line 329, in differential_evolution
    ret = solver.solve()
  File "/home/souradeep.pal/.conda/envs/pycbc-live-dev/lib/python3.9/site-packages/scipy/optimize/_differentialevolution.py", line 903, in solve
    result = minimize(self.func,
  File "/home/souradeep.pal/.conda/envs/pycbc-live-dev/lib/python3.9/site-packages/scipy/optimize/_minimize.py", line 692, in minimize
    res = _minimize_lbfgsb(fun, x0, args, jac, bounds,
  File "/home/souradeep.pal/.conda/envs/pycbc-live-dev/lib/python3.9/site-packages/scipy/optimize/_lbfgsb_py.py", line 296, in _minimize_lbfgsb
    raise ValueError("LBFGSB - one of the lower bounds is greater than an upper bound.")
ValueError: LBFGSB - one of the lower bounds is greater than an upper bound.

Also wanted to flag slightly different error also occured in one of the tests, at /home/souradeep.pal/dump/pycbc_new/examples/live/output_01/2020_05_06/candidate_1272790260.106_byqa/optimize_snr

2023-06-27T10:54:43.351-07:00 Running with CPU support: 1 threads
2023-06-27T10:54:44.878-07:00 Starting optimize SNR
2023-06-27T10:54:44.913-07:00 Starting optimization
2023-06-27T10:54:45.151-07:00 Currently at 0 0.0
2023-06-27T10:54:45.323-07:00 Currently at 1 0.0
2023-06-27T10:54:45.489-07:00 Currently at 2 0.0
2023-06-27T10:54:45.697-07:00 Currently at 3 0.0
2023-06-27T10:54:45.959-07:00 Currently at 4 0.0
2023-06-27T10:54:46.151-07:00 Currently at 5 0.0
2023-06-27T10:54:46.436-07:00 Currently at 6 0.0
2023-06-27T10:54:46.767-07:00 Currently at 7 0.0
2023-06-27T10:54:47.180-07:00 Currently at 8 0.0
2023-06-27T10:54:47.619-07:00 Currently at 9 0.0
2023-06-27T10:54:48.089-07:00 Currently at 10 0.0
2023-06-27T10:54:48.637-07:00 Currently at 11 0.0
2023-06-27T10:54:49.459-07:00 Currently at 12 0.0
2023-06-27T10:54:50.696-07:00 Currently at 13 0.0
2023-06-27T10:54:52.565-07:00 Currently at 14 0.0
2023-06-27T10:54:54.895-07:00 Currently at 15 0.0
2023-06-27T10:54:57.668-07:00 Currently at 16 0.0
2023-06-27T10:55:00.339-07:00 Currently at 17 0.0
2023-06-27T10:55:03.424-07:00 Currently at 18 0.15462157602934376
2023-06-27T10:55:06.209-07:00 Currently at 19 0.16560150890361205
2023-06-27T10:55:09.992-07:00 Currently at 20 0.17236986544963082
2023-06-27T10:55:13.146-07:00 Currently at 21 0.17882036802081058
2023-06-27T10:55:15.927-07:00 Currently at 22 0.1865365689618426
2023-06-27T10:55:19.042-07:00 Currently at 23 0.19182247229642543
2023-06-27T10:55:22.343-07:00 Currently at 24 0.19405987525030838
2023-06-27T10:55:25.522-07:00 Currently at 25 0.20203903396052553
2023-06-27T10:55:28.662-07:00 Currently at 26 0.20411059874279117
2023-06-27T10:55:31.873-07:00 Currently at 27 0.20520980126113925
2023-06-27T10:55:34.528-07:00 Currently at 28 0.20420279829960586
2023-06-27T10:55:37.400-07:00 Currently at 29 0.20281260104309384
2023-06-27T10:55:40.478-07:00 Currently at 30 0.20073743632326843
2023-06-27T10:55:43.343-07:00 Currently at 31 0.20419028268475006
2023-06-27T10:55:46.111-07:00 Currently at 32 0.19804654985944953
2023-06-27T10:55:48.537-07:00 Currently at 33 0.20253832569744024
2023-06-27T10:55:50.922-07:00 Currently at 34 0.19518764900428548
2023-06-27T10:55:53.440-07:00 Currently at 35 0.18661245489467423
2023-06-27T10:55:55.938-07:00 Currently at 36 0.18725025554715025
2023-06-27T10:55:58.781-07:00 Currently at 37 0.19005949592404217
2023-06-27T10:56:02.166-07:00 Currently at 38 0.19002199548402401
2023-06-27T10:56:04.677-07:00 Currently at 39 0.18468736075098843
2023-06-27T10:56:07.380-07:00 Currently at 40 0.17153755680413577
2023-06-27T10:56:10.209-07:00 Currently at 41 0.1700399314608005
2023-06-27T10:56:12.938-07:00 Currently at 42 0.16439953546043698
2023-06-27T10:56:15.565-07:00 Currently at 43 0.15151417248297913
2023-06-27T10:56:18.492-07:00 Currently at 44 0.15189149977458652
2023-06-27T10:56:21.146-07:00 Currently at 45 0.1452060009947811
2023-06-27T10:56:23.687-07:00 Currently at 46 0.14563697856653474
2023-06-27T10:56:26.522-07:00 Currently at 47 0.13801852087973493
2023-06-27T10:56:29.530-07:00 Currently at 48 0.13521316039258574
2023-06-27T10:56:32.129-07:00 Currently at 49 0.13278678595439428
Traceback (most recent call last):
  File "/home/souradeep.pal/.conda/envs/pycbc-live-ori/bin/pycbc_optimize_snr", line 351, in <module>
    opt_params = optimize_func(bounds, args, extra_args)
  File "/home/souradeep.pal/.conda/envs/pycbc-live-ori/bin/pycbc_optimize_snr", line 133, in optimize_di
    results = differential_evolution(
  File "/home/souradeep.pal/.conda/envs/pycbc-live-ori/lib/python3.9/site-packages/scipy/optimize/_differentialevolution.py", line 402, in differential_evolution
    ret = solver.solve()
  File "/home/souradeep.pal/.conda/envs/pycbc-live-ori/lib/python3.9/site-packages/scipy/optimize/_differentialevolution.py", line 1082, in solve
    result = minimize(self.func,
  File "/home/souradeep.pal/.conda/envs/pycbc-live-ori/lib/python3.9/site-packages/scipy/optimize/_minimize.py", line 643, in minimize
    bounds = _validate_bounds(bounds, x0, meth)
  File "/home/souradeep.pal/.conda/envs/pycbc-live-ori/lib/python3.9/site-packages/scipy/optimize/_minimize.py", line 996, in _validate_bounds
    raise ValueError(msg)
ValueError: An upper bound is less than the corresponding lower bound.

@GarethCabournDavies
Copy link
Contributor

GarethCabournDavies commented Jun 30, 2023

Could you rebase to master? (There should be a 'sync fork' option when you go to https://github.com/SouradeepPal/pycbc/tree/skymap-only) Actually it would be easier for you to do this locally

I think this could be solved by #4338, but I'm not 100%

@SouradeepPal
Copy link
Contributor Author

Could you rebase to master? (There should be a 'sync fork' option when you go to https://github.com/SouradeepPal/pycbc/tree/skymap-only) Actually it would be easier for you to do this locally

I think this could be solved by #4338, but I'm not 100%

@SouradeepPal
Copy link
Contributor Author

I had synced fork, now I accidentally closed the pr!

@SouradeepPal SouradeepPal reopened this Jul 1, 2023
@spxiwh
Copy link
Contributor

spxiwh commented Jul 2, 2023

I guess my only concern with this is ensuring that the optimizer gets the right data for V1 in the case of V1 being used as a skymap-only ifo. Maybe this could be checked in different ways (e.g. comparing data with/without the skymap-only-ifo flag that the optimizer gets sent).I do agree that the optimizer before the patch Gareth mentions may never have worked well in the cases here.

@SouradeepPal
Copy link
Contributor Author

SouradeepPal commented Jul 3, 2023

With the patch that Gareth mentioned, till now I could not find any error, but yes the files /home/souradeep.pal/pycbc/examples/live/output_HLV/2020_05_06/candidate_1272790260.106_efap/optimize_snr/coinc-1272790260.116.xml.gzand /home/souradeep.pal/pycbc/examples/live/output_HLv/2020_05_06/candidate_1272790260.113_fzwn/optimize_snr/coinc-1272790260.116.xml.gz provided for optimization (HLV vs HLv) are not identical, though the epoch times are same and the skymaps are close!
LV_Vleft_vright

Copy link
Contributor

@spxiwh spxiwh left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@SouradeepPal Okay thanks. I think this is now ready to move over to testing in the MDC (@titodalcanton). I'm giving approval to merge, but please remove the commented lines first as requested (this should also restart the CI tests), then we can merge.

pycbc/io/live.py Show resolved Hide resolved
pycbc/io/live.py Show resolved Hide resolved
pycbc/io/live.py Show resolved Hide resolved
pycbc/io/live.py Outdated
@@ -195,11 +195,11 @@ def __init__(self, coinc_ifos, ifos, coinc_results, **kwargs):
# assumptions and checks
bayestar_check_fields = ('mass1 mass2 mtotal mchirp eta spin1x '
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

bayestar_check_fields and the comment above should also now be removed, as it is now unused.

@tdent
Copy link
Contributor

tdent commented Jul 4, 2023

@SouradeepPal to deal with the question of why things are reproducible or identical, we suggested on the call to give the random seed option in optimize_snr a default value (eg 42 ..) so that it's always used unless someone overrides it.

@spxiwh
Copy link
Contributor

spxiwh commented Jul 4, 2023

@tdent I was basically ready to press the merge button on this. Do you want to hold up to make that change ... or not?

@tdent
Copy link
Contributor

tdent commented Jul 4, 2023

We had discussion on the pycbc call and from what I remember I don't know if Tito was convinced by the testing and it didn't seem like there was a consensus that this should be merged immediately.
Including a fixed random seed for reproducibility may help to address that.

@tdent
Copy link
Contributor

tdent commented Jul 4, 2023

FWIW, as far as I can see the previous optimizer errors should be addressed by the recent commits that fix the mass ranges to be 'saner'. So we don't expect any such errors to persist with the current state of the code

@SouradeepPal
Copy link
Contributor Author

It seems fixing the seed in pycbc_optimize_snr produces the same skymap in the optimized HLV and HLv cases:
seeded_HLVLe_HLvRi

The contents of the coinc*.xml files now look identical, the snrseries, psds.. have run >3 times and each produced the same results. Also I did not face any error with optimization in these tests.

So I have pushed a default of 42 for the seed arg in the optimize_snr code. Is that okay.

SouradeepPal and others added 2 commits July 7, 2023 14:50
I remove an unnecessary FIXME in the comments, but mostly doing this to restart the CI tests, which seem to have not linked up right.
@spxiwh
Copy link
Contributor

spxiwh commented Jul 10, 2023

Okay, I'll merge this now as soon as I can persuade the CI tests to pass.

@spxiwh
Copy link
Contributor

spxiwh commented Jul 10, 2023

@SouradeepPal Unfortunately this needs to be rebased again. :-(

@spxiwh spxiwh merged commit d4a9f38 into gwastro:master Jul 11, 2023
bhooshan-gadre pushed a commit to bhooshan-gadre/pycbc that referenced this pull request Jul 11, 2023
…4346)

* Introduced a new arguement --skymap-only-ifos in pycbc_live

* Default skymap_only_ifos changed

* skymap_only_ifos as an attribute of LiveEventManager

* Test skymaps with V1 as skymap_only_ifos

* singles with skymap_only_ifos

* Removing commented lines etc

* A default seed for SNR opt

* Poking CI tests

I remove an unnecessary FIXME in the comments, but mostly doing this to restart the CI tests, which seem to have not linked up right.

---------

Co-authored-by: Souradeep Pal <[email protected]>
Co-authored-by: Ian Harry <[email protected]>
tdent added a commit that referenced this pull request Jul 26, 2023
* Try to fix CI tests (#4394)

* Switch FFTW/MKL order of preference

* Swap backend order and force gomp import

* FIx typo

* Do need openmpi in tox.ini

* Fix bug in MKL error function

* Force FFTW on this one.

* CC

* Requested Josh changes

* Add bank corner plot (#4339)

* Add corner plotting script for template banks

* Comment where premerger duration has been subtracted from template duration in bank_conversions

* add premerger_duration to bank_conversions.py

* Move premerger duration into bank_conversions

* Use bank's approximant

* Dont plot signular values as default

* CC complaints

* docstring

* TDC comments

* Keep approximant kwarg as default, TDC comments 2

* Added an OSError exception to MKL check (#4390)

* Add a possibility for defaultvalues sections in config files (#4385)

* Add a possibility for defaultvalues sections in config files

* do not allow [section] and [section-defaultvalues] options

* defaultvalues for top-level sections only

* underscore on add_ini_opts

* Remove default sections from get_subsections (#4399)

* Update setup-python action to v4 (#4400)

* Replace LOSC with GWOSC (#4401)

* Replace LOSC with GWOSC

* Fix leftover Python 2-ism

* Try to improve codeclimate

* Try to fix codeclimate

* Try to fix codeclimate

* Try to fix codeclimate

* Exclude IFO sections when looping through the get_subsections (#4402)

* Exclude IFO sections when looping through the get_subsections for plots

* Add an example whihc would have previously failed into the search config

* Offline singles in workflow (#4386)

* Add single-detector options into workflow

* Fix a couple of isses which make results pages weird

* fix

* fix gen.sh to use correct workflow generator

* revert change made in error

* A couple of points which state coincident when it may not be

* Rejection samp (#4379)

* unexpected events

* added temp-volume in cl

* added rejection sampling

* added indexing of mchirp in fit_param

* added compensation factor

* added corrections

* added more corrections

* added random number generator seed

* added mchirp instead of log(mchirp) in rejection samp

* Use probabilities to compensate downsampled kde

* Try to deal with flaky failures when apt-getting (#4384)

* Implement pre-cuts in fit_over_multiparam for efficiency (#4374)

* Make some efficiency savings in pycbc_fit_sngls_over_multiparam

* Missing logging line in once case

* Add in progress reporting, in case of silent failure

* I thought we needed some leeway, but we don't

* TD comments

* Simplify comment

* Migrate to new gwdatafind API (#4383)

* Migrate to new gwdatafind API

* CC and one regression fix

* One more style change

* Don't need these options now

* Revert "Don't need these options now"

This reverts commit 6f2ed1b.

* Add a Fisher distribution for sky locations (#4209)

* Update transforms.py

Adding new_z_to_euler and rotate_euler from pylal.sphericalutils

* Update sky_location.py

Added new class FisherDist for drawing from sky locations (in ra, dec)

* Update sky_location.py

Included help message for fisherDist

* Update sky_location.py

* Code climate issues

* Code climate issues

* Code-climate changes

* Code climate issues

* Code climate issues

* Update transforms.py

changed lal.PI to numpy.pi in new_z_to_euler

* Update transforms.py

minor changes

* Update sky_location.py

updated docstring, did changes to make the code look more simple

* Update sky_location.py

typos corrected

* Update sky_location.py

code climate changes

* Update sky_location.py

* Update sky_location.py

Included the definitions rvs_polaz and rvs_radec

* Update transforms.py

Included the definitions decra2polaz and polaz2decra

* Update sky_location.py

* Update transforms.py

code climate issues fixed

* Update sky_location.py

code climate issues fixed

* Update sky_location.py

code climate issues

* Update sky_location.py

fixed code climate issues

* Update sky_location.py

fixed code climate issues

* Update sky_location.py

* Update pycbc/distributions/sky_location.py

Co-authored-by: Tito Dal Canton <[email protected]>

* Update sky_location.py

* Update sky_location.py

* Update transforms.py

modified polaz2decra to polaz2radec

* Update sky_location.py

* Update sky_location.py

Forgotten polaz2decra --> polaz2radec

* Update sky_location.py

Code climate fixes

* Update sky_location.py

Updated the code for checking the effectiveness of running from config file

* Create sky_location_old.py

* modified to include from config

* Modified to run from config file

* Added Fisher distribution to the lista of available distributions

* Delete sky_location_old.py

* Update sky_location.py

* Renamed Fisher to FisherSky

* Updated the name to FisherSky

* changed Fisher to FisherSky in __all__

* removed decra2polaz and polaz2radec to conversions

* Included def decra2polaz, polaz2radec in line 859

* Added angle_unit option

* removed decra2polaz and polaz2decra

* made carresction

* made corrections

* Corrected the typing error while removing recra2polaz

* Modified angle_unit and updated init file

* Empty line on 852 retrieved

* corrected

* Empty line on852 retrieved

* Fixed code climate issues

* Sigma conversion taken care of

* Fixed code climate issues

* Update sky_location.py

Codeclimate

* Update test_distributions.py

Adding fisher_sky to the list of distributions that do not undergo the distribution unittests.

* Update sky_location.py

Syntax fixed.

* Update sky_location.py complying to codeclimate

* Refactor using scipy's Rotation

* Improve docstring and make warning stricter

* Update pycbc/distributions/sky_location.py

Co-authored-by: Francesco Pannarale <[email protected]>

* Update pycbc/distributions/sky_location.py

right angle to correct angle

Co-authored-by: Francesco Pannarale <[email protected]>

* Update sky_location.py

logging issue solved

---------

Co-authored-by: Francesco Pannarale <[email protected]>
Co-authored-by: Tito Dal Canton <[email protected]>
Co-authored-by: P Prasia <[email protected]>
Co-authored-by: Tito Dal Canton <[email protected]>

* add in several missing marginalization combinations (#4376)

* allow polarization marginalization with earth rotation

* add in missing marg combos

* fixes

* fixes

* fixes

* cleanup

* cc

* cc

* Try to fix CI tests (#4394)

* Switch FFTW/MKL order of preference

* Swap backend order and force gomp import

* FIx typo

* Do need openmpi in tox.ini

* Fix bug in MKL error function

* Force FFTW on this one.

* CC

* Requested Josh changes

* Add bank corner plot (#4339)

* Add corner plotting script for template banks

* Comment where premerger duration has been subtracted from template duration in bank_conversions

* add premerger_duration to bank_conversions.py

* Move premerger duration into bank_conversions

* Use bank's approximant

* Dont plot signular values as default

* CC complaints

* docstring

* TDC comments

* Keep approximant kwarg as default, TDC comments 2

* Added an OSError exception to MKL check (#4390)

* Add a possibility for defaultvalues sections in config files (#4385)

* Add a possibility for defaultvalues sections in config files

* do not allow [section] and [section-defaultvalues] options

* defaultvalues for top-level sections only

* underscore on add_ini_opts

* Remove default sections from get_subsections (#4399)

* Update setup-python action to v4 (#4400)

* Replace LOSC with GWOSC (#4401)

* Replace LOSC with GWOSC

* Fix leftover Python 2-ism

* Try to improve codeclimate

* Try to fix codeclimate

* Try to fix codeclimate

* Try to fix codeclimate

* Exclude IFO sections when looping through the get_subsections (#4402)

* Exclude IFO sections when looping through the get_subsections for plots

* Add an example whihc would have previously failed into the search config

* Offline singles in workflow (#4386)

* Add single-detector options into workflow

* Fix a couple of isses which make results pages weird

* fix

* fix gen.sh to use correct workflow generator

* revert change made in error

* A couple of points which state coincident when it may not be

---------

Co-authored-by: Thomas Dent <[email protected]>
Co-authored-by: Ian Harry <[email protected]>
Co-authored-by: Gareth S Cabourn Davies <[email protected]>
Co-authored-by: Prasia-Pankunni <[email protected]>
Co-authored-by: Francesco Pannarale <[email protected]>
Co-authored-by: Tito Dal Canton <[email protected]>
Co-authored-by: P Prasia <[email protected]>
Co-authored-by: Tito Dal Canton <[email protected]>
Co-authored-by: Alex Nitz <[email protected]>
Co-authored-by: Arthur Tolley <[email protected]>
Co-authored-by: Tito Dal Canton <[email protected]>

* Adding SEOBNRv5Peak key and function in the final frequency cutoff dictionary (#4408)

Co-authored-by: KHUN PHUKON <[email protected]>

* Injection kde (#4409)

* unexpected events

* added temp-volume in cl

* added injection kde

* significance bug for trigger_fit. A couple of minor fixes (#4407)

* Upgrades to pycbc_grb_inj_finder (#4364)

* retaining single ifo injection information

* Update pycbc_grb_inj_finder

Update according to requested changes from pull request review.

* Adding more specific comments

Co-authored-by: Francesco Pannarale <[email protected]>

* Adding more specific comments

out_dict changed to "output dictionary" in comment

Co-authored-by: Francesco Pannarale <[email protected]>

* Remove xlen

Removed xlen from cp_dataset_cont and instead calculated the length of xidentifier within the function.

* Reverting comment changes

* Remove extra comment

* Francesco's bug fix

Modified to simplify and correct where ifo information was jumbled together

* remove trig_dict and comment

* Removed extra lines

Removed line and datasets = {}

* Update to copyright comment and imports

Added our names and accounted for older python version.

---------

Co-authored-by: Francesco Pannarale <[email protected]>

* Simple bugfix (#4413)

Co-authored-by: Bhooshan Gadre <[email protected]>

* Move PyCBC venvs to new IGWN CVMFS server (#4412)

* First part of moving venv build to igwn

* TESTING HACK. REVERT ME BEFORE MERGING!!!

* Try this

* Testing

* Revert "Testing"

This reverts commit c0b9ea0.

* Add new CVMFS commands

* Remove rsync filter which isn't working

* Add error wrap abort handler

* Update tools/venv_transfer_commands.sh

Co-authored-by: Duncan Macleod <[email protected]>

* Fix Ian's idiocy (attempt to) and HostChecking

* Set to abort for one last test

* One final publish test

* Add a chmod on the root CVMFS directory

* Prepare for merging

* Fix mistake

---------

Co-authored-by: Duncan Macleod <[email protected]>

* Get FFT options in pycbc_condition_strain (#4404)

* pycbc_optimize_snr: Implement mass dependent bounds on spin parameters (#4176)

* Applying spin bounds based upon object mass~

* Updated reference to correct paper

* Adding spin bounds based on upper bounds of masses

* removing unnecessary additions

* Changing max mass2 to the right quantities

* Creating maxeta + reusing maxm1

* minor cleanup

* fixed min / max eta values

* fixed min / max eta

* Correcting maxm2 equation

* more readable/less redundant comment

---------

Co-authored-by: Thomas Dent <[email protected]>

* Allow SNR optimizer to use candidate point in initial array (#4393)

* allow SNR optimizer to use the candidate point in the initial array of test points

* update two LISA docs (#4417)

* Update injection_smbhb.ini

* Update lisa_smbhb_relbin.ini

* Update lisa_smbhb_relbin.ini

* Update lisa_smbhb_relbin.ini

* Update lisa_smbhb_ldc_pe.rst

* Allow pycbc_multi_inspiral to search over a sky grid (#4380)

* Allow pycbc_multi_inspiral to search over a sky grid

* Adding the possibility to give either a sky grid or a sky position

* Change the names of the command lines --ra and --dec to --latitude and --longitude to match the changes made in pycbc_multi_inspiral and remove --processing-scheme because it makes the example crash

* Compute the antenna pattern only once for each sky position by keeping fp and fc together

* Replace the number of detectors from a hardcoded value to a variable

* add TDI AE PSD with confusion noise for LISA (#4389)

* add TDI AE PSD with confusion noise

* Update analytical_space.py

* fix cc issue

* Update analytical.py

* EM brute (#4299)

* Space before colons in eos_utils.py help messages

* Enable extrapolation in eos_utils.py when NS is out of bounds

* Same check on shape in primary_mass and secondary mass

* Function to swap masses and spins of object 1 and object2

* Allow user to request for remnant_mass calculations: 1) extrapolation, 2) swapping object 1 and object 2 if mass2 > mass1, 3) treat as a (dark) BBH and NSBH with NS mass greater than a value probided by the user

* Renamned swap_companions to ensure_obj1_is_primary and generalized it

* codeclimate

* codeclimate

* Fixed line that was too long

* Fixed docstring and using keywords explicitly in all remnant_mass_* calls

* Renamed max_ns_mass as ns_bh_mass_boundary and improved help messages of functions

* Improved docstings

* Comprehensions in pycbc_brute_bank

* Complying to naming convention for spin components in spherical coordinates

* Update conversions.py

Fixing single code climate complaint.

* Prevent duplicates of the HLV page_ifar plot on the summary page (#4421)

* Prevent duplicates of the HLV page_ifar plot on the summary page

* Rename 'coincidences' as appropriate

* add high frequency sky location dependent response for long detectors (#4377)

* reset commit, add in high freqeuncy response to detector

* update

* fixes

* Make pegasus 5.0.5 work (#4276)

* Revert "try pinning pegasus version (#4265)"

This reverts commit 398e135.

* Set for_planning flag for subworkflow output map

* Add version check so we don't break 5.0.3

* Also include 5.0.4

* make ci faster (#4414)

* update

* move long log into debug level, allow to set debug level

* fix workflow

* more explicit control of running external scripts for docs setup at same time

* fixes

* update

* try this

* try this ...

* update

* fixes

* update

* updates

* mistake in example search config file (#4425)

* mistake in example search config file

* add failure if search runs too long

* Range_temp kde (#4424)

* unexpected events

* added temp-volume in cl

* setting the range for temp_kde

* setting min based on max kde

* logging for min template kde ratio

---------

Co-authored-by: Thomas Dent <[email protected]>

* Pygrb offline workflow (#4288)

* Fixed indexing and autochisq argument in pycbc_multi_inspiral

* Only Hanford is labelled with a 1: avoiding pycbc_pygrb_plot_snr_timeseries failure.  trigs rather than trigs_or_injs as variable name in pycbc_pygrb_plot_coh_ifosnr

* Simplified and update pycbc_pygrb_plot_injs_results; adapted pycbc_pygrb_pp_workflow

* Forgotten comma

* Massive commit that stitches together pycbc_make_offline_grb_workflow and pycbc_pygrb_pp_workflow, by picking up the latter as a SubWorkflow.

* Massive commit that stitches together pycbc_make_offline_grb_workflow and pycbc_pygrb_pp_workflow, by picking up the latter as a SubWorkflow.

* Code-climate fixes

* More code-climate

* Import error flagged by code-climate

* Forgotten import fixes

* Minor cleanup of comments or commented out code lines

* Syntax fix

* Defining 2 empty file lists

* First part of PR 4288 review comments

* One more TODO

* opt_to_file is now configparser_value_to_file in pycbc/workflow/core.py

* Upgraded configparser_value_to_file with attrs keyword argument

* Using configparser_value_to_file throughout the PyGRB workflow generator

* Removing 2 unused PyGRB functions

* Removed LigolwCBCAlignTotalSpinExecutable, LigolwCBCJitterSkylocExecutable, and PycbcDarkVsBrightInjectionsExecutable support in general and removed LalappsInspinjExecutable support from PyGRB

* Codeclimate

* bank_veto_file variable needs to be a FileList, not a File

* Bug with tags for single IFO SNR plots workflow generator

* Fixing pycbc_pygrb_plot_coh_ifosnr

* Fixing layout of chi-square plots and section label for individual detector SNRs

* Codeclimate

* Codeclimate

* Codeclimate

* Removed FIXME for testing purposes

* First changes following up on PR review

* Second round of changes following up on PR review

* Flagging with an underscore grb utility functions not used outside the files they are defined in

* Flagging with an underscore grb utility functions not used outside the files they are defined in

* Removed _get_antenna_factors from PyGRB utily file

* Removed commented out function from pycbc_pygrb_plot_injs_results

* Substituted old unused code with a TODO

* Adding injection set name as an option in pycbc_pygrb_efficiency

* extend --> append for single files

* Documenting setup_pygrb_pp_workflow more appropriately

* Reverted name of _get_antenna_responses to get_antenna_responses; cleaner handling of bank-veto-bank-file for pycbc_multi_inspiral job setup.

* Line shortened

* Avoid skymap v1.1.0 (#4429)

* only download LISA response file once (#4423)

* Update analytical_space.py

* Update analytical_space.py

* Introduced a new arguement --skymap-only-ifos in pycbc_live (#4346)

* Introduced a new arguement --skymap-only-ifos in pycbc_live

* Default skymap_only_ifos changed

* skymap_only_ifos as an attribute of LiveEventManager

* Test skymaps with V1 as skymap_only_ifos

* singles with skymap_only_ifos

* Removing commented lines etc

* A default seed for SNR opt

* Poking CI tests

I remove an unnecessary FIXME in the comments, but mostly doing this to restart the CI tests, which seem to have not linked up right.

---------

Co-authored-by: Souradeep Pal <[email protected]>
Co-authored-by: Ian Harry <[email protected]>

* Fix stageout (#4428)

* Fix the help message for stageout script

* Fix the help message for stageout and copy map scripts

---------

Co-authored-by: connor-mcisaac <[email protected]>

* more physical rwrap for LISA SMBHB/SOBHB injection (follow-up fix 2) (#4350)

* more physical rwrap

* fix cc issues

* Update waveform.py

* Update companion.txt

* Update requirements.txt

* Update requirements.txt

* Update companion.txt

* 10 times tau

* Update companion.txt

* Update requirements.txt

* Update setup.py

* add check

* Update waveform.py

* allow user to choose rwarp

* fix cc issue

* set 0.2 as minimum rwrap

* Update waveform.py

* Remove most X509/globus links and hooks from PyCBC (#4375)

* Remove most X509/globus links and hooks from PyCBC

* Need to update this one as well

* Don't need these options now

* Update docs/workflow/pycbc_make_coinc_search_workflow.rst

Co-authored-by: Gareth S Cabourn Davies <[email protected]>

---------

Co-authored-by: Gareth S Cabourn Davies <[email protected]>

* fftw_fix (#4418)

* Allow pycbc inspiral to run with only numpy fft

* Remove Unneeded function from npfft.py

---------

Co-authored-by: Neeresh Kumar Perla <[email protected]>

* Add argument verification for singles (#4365)

* Add argument verification for singles

* Apply suggestions from code review

* remove --enable-single-detector-background

* Some more option-checking, and making fixed ifar option actually possible!

* fix options in example

* CC, typo

* CC

* Move versioning page generation into its own executable (#4431)

* Move versioning page generation into its own executable

* Allow duplicated executables

* 🤦

* CC changes

* CC

* save_fig_with_metadata cannot be imported from versioning

* Don't like spaces in arguments

* Ian's comments

* Dont pass executables as files

* Same type output from get_code_version_numbers

* Rename --longitude and --latitude back to --ra and --dec (#4433)

* bugfix - allow non-running of singles (#4439)

* bugfix - allow non-running of singles

* CC

* Revrt wrongly-added test chnages

* Add IMRPhenomXAS template duration (#4410)

* Add IMRPhenomXAS template duration

* removing assertion

* fixed fomatting for codeclimate

* Adding PhenomXAS duration and removing space fixes

* removing extra new line

---------

Co-authored-by: Bhooshan Gadre <[email protected]>

* Treat CVMFS better (#4440)

* dqsegdb2 update (#4442)

* dqsegdb2 update

* Update requirements-igwn.txt

Co-authored-by: Duncan Macleod <[email protected]>

---------

Co-authored-by: Ian Harry <[email protected]>
Co-authored-by: Duncan Macleod <[email protected]>

---------

Co-authored-by: Ian Harry <[email protected]>
Co-authored-by: Gareth S Cabourn Davies <[email protected]>
Co-authored-by: Arthur Tolley <[email protected]>
Co-authored-by: Tito Dal Canton <[email protected]>
Co-authored-by: Praveen Kumar <[email protected]>
Co-authored-by: Prasia-Pankunni <[email protected]>
Co-authored-by: Francesco Pannarale <[email protected]>
Co-authored-by: Tito Dal Canton <[email protected]>
Co-authored-by: P Prasia <[email protected]>
Co-authored-by: Tito Dal Canton <[email protected]>
Co-authored-by: Alex Nitz <[email protected]>
Co-authored-by: Khun Sang Phukon <[email protected]>
Co-authored-by: KHUN PHUKON <[email protected]>
Co-authored-by: ETVincent <[email protected]>
Co-authored-by: Bhooshan Uday Varsha Gadre <[email protected]>
Co-authored-by: Bhooshan Gadre <[email protected]>
Co-authored-by: Duncan Macleod <[email protected]>
Co-authored-by: Shichao Wu <[email protected]>
Co-authored-by: hoangstephanie <[email protected]>
Co-authored-by: SouradeepPal <[email protected]>
Co-authored-by: Souradeep Pal <[email protected]>
Co-authored-by: Ian Harry <[email protected]>
Co-authored-by: connor-mcisaac <[email protected]>
Co-authored-by: Neeresh Kumar <[email protected]>
Co-authored-by: Neeresh Kumar Perla <[email protected]>
PRAVEEN-mnl pushed a commit to PRAVEEN-mnl/pycbc that referenced this pull request Nov 3, 2023
…4346)

* Introduced a new arguement --skymap-only-ifos in pycbc_live

* Default skymap_only_ifos changed

* skymap_only_ifos as an attribute of LiveEventManager

* Test skymaps with V1 as skymap_only_ifos

* singles with skymap_only_ifos

* Removing commented lines etc

* A default seed for SNR opt

* Poking CI tests

I remove an unnecessary FIXME in the comments, but mostly doing this to restart the CI tests, which seem to have not linked up right.

---------

Co-authored-by: Souradeep Pal <[email protected]>
Co-authored-by: Ian Harry <[email protected]>
titodalcanton pushed a commit to titodalcanton/pycbc that referenced this pull request Jan 16, 2024
…4346)

* Introduced a new arguement --skymap-only-ifos in pycbc_live

* Default skymap_only_ifos changed

* skymap_only_ifos as an attribute of LiveEventManager

* Test skymaps with V1 as skymap_only_ifos

* singles with skymap_only_ifos

* Removing commented lines etc

* A default seed for SNR opt

* Poking CI tests

I remove an unnecessary FIXME in the comments, but mostly doing this to restart the CI tests, which seem to have not linked up right.

---------

Co-authored-by: Souradeep Pal <[email protected]>
Co-authored-by: Ian Harry <[email protected]>
acorreia61201 pushed a commit to acorreia61201/pycbc that referenced this pull request Apr 4, 2024
…4346)

* Introduced a new arguement --skymap-only-ifos in pycbc_live

* Default skymap_only_ifos changed

* skymap_only_ifos as an attribute of LiveEventManager

* Test skymaps with V1 as skymap_only_ifos

* singles with skymap_only_ifos

* Removing commented lines etc

* A default seed for SNR opt

* Poking CI tests

I remove an unnecessary FIXME in the comments, but mostly doing this to restart the CI tests, which seem to have not linked up right.

---------

Co-authored-by: Souradeep Pal <[email protected]>
Co-authored-by: Ian Harry <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

5 participants