Skip to content

Commit

Permalink
feat: support pdf link extraction in hi_res strategy <- Ingest test f…
Browse files Browse the repository at this point in the history 
…ixtures update (#3761)

This pull request includes updated ingest test fixtures.
Please review and merge if appropriate.

Co-authored-by: christinestraub <[email protected]>
  • Loading branch information
@ryannikolaidis @christinestraub
ryannikolaidis and christinestraub authored Oct 30, 2024
1 parent 6fa0c09 commit c5772f3
Show file tree
Hide file tree
Showing 7 changed files with 159 additions and 159 deletions.
34 changes: 17 additions & 17 deletions ..._unstructured_ingest/expected-structured-output/biomed-api/65/11/main.PMC6312790.pdf.json
View file
Original file line number Diff line number Diff line change
Expand Up @@ -10,7 +10,7 @@
"links": [
{
"start_index": 0,
"text": "DatainBrief22 ( 2019 ) 451 –",
"text": "Data in Brief 22 ( 2019 ) 451 – 457",
"url": "https://doi.org/10.1016/j.dib.2018.11.134"
}
],
Expand Down Expand Up @@ -42,8 +42,8 @@
],
"links": [
{
"start_index": -1,
"text": "",
"start_index": 28,
"text": "ScienceDirect",
"url": "www.sciencedirect.com/science/journal/23523409"
}
],
Expand Down Expand Up @@ -76,7 +76,7 @@
"links": [
{
"start_index": 18,
"text": "www . elsevier . com / locate /",
"text": "www . elsevier . com / locate / dib",
"url": "www.elsevier.com/locate/dib"
}
],
Expand Down Expand Up @@ -347,7 +347,7 @@
},
{
"start_index": 0,
"text": "https :// doi . org / 10 . 1016 / j . dib . 2018 . 11 .",
"text": "https :// doi . org / 10 . 1016 / j . dib . 2018 . 11 . 134",
"url": "https://doi.org/10.1016/j.dib.2018.11.134"
}
],
Expand Down Expand Up @@ -1224,8 +1224,8 @@
],
"links": [
{
"start_index": 94,
"text": ":// doi",
"start_index": 89,
"text": "https :// doi .",
"url": "https://doi.org/10.1016/j.dib.2018.11.134"
},
{
Expand Down Expand Up @@ -1263,17 +1263,17 @@
"links": [
{
"start_index": 4,
"text": "O . Sanni , A . P . I . Popoola , O . S . I . Fayomi ,",
"text": "O . Sanni , A . P . I . Popoola , O . S . I . Fayomi , Enhanced corrosion resistance of stainless steel type 316 in sulphuric acid solution",
"url": "http://refhub.elsevier.com/S2352-3409(18)31527-0/sbref1"
},
{
"start_index": 0,
"text": "usingeco - friendlywasteproduct , ResultsPhys . 9 ( 2018 ) 225 –",
"text": "using eco - friendly waste product , Results Phys . 9 ( 2018 ) 225 –",
"url": "http://refhub.elsevier.com/S2352-3409(18)31527-0/sbref1"
},
{
"start_index": 0,
"text": "usingeco - friendlywasteproduct , ResultsPhys . 9 ( 2018 ) 225 – 230",
"text": "using eco - friendly waste product , Results Phys . 9 ( 2018 ) 225 – 230 .",
"url": "http://refhub.elsevier.com/S2352-3409(18)31527-0/sbref1"
}
],
Expand All @@ -1293,17 +1293,17 @@
"links": [
{
"start_index": 4,
"text": "O . Sanni , A . P . I . Popoola , A . Kolesnikov ,",
"text": "O . Sanni , A . P . I . Popoola , A . Kolesnikov , Constitutive modeling for prediction of optimal process parameters in corrosion",
"url": "http://refhub.elsevier.com/S2352-3409(18)31527-0/sbref2"
},
{
"start_index": 0,
"text": "inhibitionofausteniticstainlesssteel ( Type316 )/ acidicmedium , Mater . Res . Express . 5 ( 10 )( 2018 ) 1 –",
"text": "inhibition of austenitic stainless steel ( Type 316 )/ acidic medium , Mater . Res . Express . 5 ( 10 ) ( 2018 ) 1 –",
"url": "http://refhub.elsevier.com/S2352-3409(18)31527-0/sbref2"
},
{
"start_index": 0,
"text": "inhibitionofausteniticstainlesssteel ( Type316 )/ acidicmedium , Mater . Res . Express . 5 ( 10 )( 2018 ) 1 – 15",
"text": "inhibition of austenitic stainless steel ( Type 316 )/ acidic medium , Mater . Res . Express . 5 ( 10 ) ( 2018 ) 1 – 15 .",
"url": "http://refhub.elsevier.com/S2352-3409(18)31527-0/sbref2"
}
],
Expand All @@ -1323,17 +1323,17 @@
"links": [
{
"start_index": 4,
"text": "O . Sanni , A . P . I . Popoola , O . S . I . Fayomi ,",
"text": "O . Sanni , A . P . I . Popoola , O . S . I . Fayomi , The inhibitive study of egg shell powder on UNS N08904 austenitic stainless steel",
"url": "http://refhub.elsevier.com/S2352-3409(18)31527-0/sbref3"
},
{
"start_index": 0,
"text": "corrosioninchloridesolution , Def . Technol . 14 ( 2018 ) 463 –",
"text": "corrosion in chloride solution , Def . Technol . 14 ( 2018 ) 463 –",
"url": "http://refhub.elsevier.com/S2352-3409(18)31527-0/sbref3"
},
{
"start_index": 0,
"text": "corrosioninchloridesolution , Def . Technol . 14 ( 2018 ) 463 – 468",
"text": "corrosion in chloride solution , Def . Technol . 14 ( 2018 ) 463 – 468 .",
"url": "http://refhub.elsevier.com/S2352-3409(18)31527-0/sbref3"
}
],
Expand Down Expand Up @@ -1363,7 +1363,7 @@
},
{
"start_index": 233,
"text": "https :// doi . org / 10 . 1007",
"text": "https :// doi . org / 10 . 1007 /",
"url": "https://doi.org/10.1007/s13632-018-0495-5"
},
{
Expand Down
52 changes: 26 additions & 26 deletions ..._unstructured_ingest/expected-structured-output/biomed-api/75/29/main.PMC6312793.pdf.json
View file
Original file line number Diff line number Diff line change
Expand Up @@ -10,7 +10,7 @@
"links": [
{
"start_index": 0,
"text": "DatainBrief22 ( 2019 ) 484 –",
"text": "Data in Brief 22 ( 2019 ) 484 – 487",
"url": "https://doi.org/10.1016/j.dib.2018.12.055"
}
],
Expand Down Expand Up @@ -42,8 +42,8 @@
],
"links": [
{
"start_index": -1,
"text": "",
"start_index": 28,
"text": "ScienceDirect",
"url": "www.sciencedirect.com/science/journal/23523409"
}
],
Expand Down Expand Up @@ -76,7 +76,7 @@
"links": [
{
"start_index": 18,
"text": "www . elsevier . com / locate /",
"text": "www . elsevier . com / locate / dib",
"url": "www.elsevier.com/locate/dib"
}
],
Expand Down Expand Up @@ -356,7 +356,7 @@
"links": [
{
"start_index": 25,
"text": "https :// doi . org / 10 . 1016 / j . trb . 2018 . 11 . nCorrespondingauthorat",
"text": "https :// doi . org / 10 . 1016 / j . trb . 2018 . 11 . 007 n Corresponding author at",
"url": "http://dx.doi.org/10.1016/j.trb.2018.11.007"
},
{
Expand All @@ -366,7 +366,7 @@
},
{
"start_index": 25,
"text": "https :// doi . org / 10 . 1016 / j . trb . 2018 . 11 .",
"text": "https :// doi . org / 10 . 1016 / j . trb . 2018 . 11 . 007",
"url": "http://dx.doi.org/10.1016/j.trb.2018.11.007"
}
],
Expand Down Expand Up @@ -416,7 +416,7 @@
},
{
"start_index": 0,
"text": "https :// doi . org / 10 . 1016 / j . dib . 2018 . 12 .",
"text": "https :// doi . org / 10 . 1016 / j . dib . 2018 . 12 . 055",
"url": "https://doi.org/10.1016/j.dib.2018.12.055"
}
],
Expand Down Expand Up @@ -474,8 +474,8 @@
],
"links": [
{
"start_index": 444,
"text": ".,",
"start_index": 386,
"text": "https :// orlib . uqcloud . net /",
"url": "https://orlib.uqcloud.net/"
}
],
Expand Down Expand Up @@ -585,8 +585,8 @@
],
"links": [
{
"start_index": 509,
"text": "2500 , and3000 . size , ðm ; nÞ , fiveinstancesareprovided . Thedatasetcanbedownloadedfromhttps :// orlib . uqcloud . net",
"start_index": 611,
"text": "https :// orlib . uqcloud . net",
"url": "https://orlib.uqcloud.net"
}
],
Expand Down Expand Up @@ -1008,8 +1008,8 @@
],
"links": [
{
"start_index": 94,
"text": ":// doi",
"start_index": 89,
"text": "https :// doi .",
"url": "https://doi.org/10.1016/j.dib.2018.12.055"
},
{
Expand Down Expand Up @@ -1047,17 +1047,17 @@
"links": [
{
"start_index": 4,
"text": "G . Carpaneto , M . Dell ' Amico , M . Fischetti , P . Toth ,",
"text": "G . Carpaneto , M . Dell ' Amico , M . Fischetti , P . Toth , A branch and bound algorithm for the multiple depot vehicle scheduling",
"url": "http://refhub.elsevier.com/S2352-3409(18)31594-4/sbref1"
},
{
"start_index": 0,
"text": "problem , Networks19 ( 5 )( 1989 ) 531 –",
"text": "problem , Networks 19 ( 5 ) ( 1989 ) 531 –",
"url": "http://refhub.elsevier.com/S2352-3409(18)31594-4/sbref1"
},
{
"start_index": 0,
"text": "problem , Networks19 ( 5 )( 1989 ) 531 – 548",
"text": "problem , Networks 19 ( 5 ) ( 1989 ) 531 – 548 .",
"url": "http://refhub.elsevier.com/S2352-3409(18)31594-4/sbref1"
}
],
Expand All @@ -1077,17 +1077,17 @@
"links": [
{
"start_index": 4,
"text": "N . Kliewer , T . Mellouli , L . Suhl , Atime – spacenetworkbasedexactoptimizationmodelformulti - depotbusscheduling , Eur",
"text": "N . Kliewer , T . Mellouli , L . Suhl , A time – space network based exact optimization model for multi - depot bus scheduling , Eur .",
"url": "http://refhub.elsevier.com/S2352-3409(18)31594-4/sbref2"
},
{
"start_index": 0,
"text": "J . Oper . Res . 175 ( 3 )( 2006 ) 1616 –",
"text": "J . Oper . Res . 175 ( 3 ) ( 2006 ) 1616 –",
"url": "http://refhub.elsevier.com/S2352-3409(18)31594-4/sbref2"
},
{
"start_index": 0,
"text": "J . Oper . Res . 175 ( 3 )( 2006 ) 1616 – 1627",
"text": "J . Oper . Res . 175 ( 3 ) ( 2006 ) 1616 – 1627 .",
"url": "http://refhub.elsevier.com/S2352-3409(18)31594-4/sbref2"
}
],
Expand All @@ -1107,17 +1107,17 @@
"links": [
{
"start_index": 4,
"text": "S . Kulkarni , M . Krishnamoorthy , A . Ranade , A . T . Ernst , R . Patil , Anewformulationandacolumngeneration -",
"text": "S . Kulkarni , M . Krishnamoorthy , A . Ranade , A . T . Ernst , R . Patil , A new formulation and a column generation - based heuristic",
"url": "http://refhub.elsevier.com/S2352-3409(18)31594-4/sbref3"
},
{
"start_index": 0,
"text": "forthemultipledepotvehicleschedulingproblem , Transp . Res . PartBMethodol . 118 ( 2018 ) 457 –",
"text": "for the multiple depot vehicle scheduling problem , Transp . Res . Part B Methodol . 118 ( 2018 ) 457 –",
"url": "http://refhub.elsevier.com/S2352-3409(18)31594-4/sbref3"
},
{
"start_index": 0,
"text": "forthemultipledepotvehicleschedulingproblem , Transp . Res . PartBMethodol . 118 ( 2018 ) 457 – 487",
"text": "for the multiple depot vehicle scheduling problem , Transp . Res . Part B Methodol . 118 ( 2018 ) 457 – 487 .",
"url": "http://refhub.elsevier.com/S2352-3409(18)31594-4/sbref3"
}
],
Expand All @@ -1137,12 +1137,12 @@
"links": [
{
"start_index": 4,
"text": "A . S . Pepin , G . Desaulniers , A . Hertz , D . Huisman ,",
"text": "A . S . Pepin , G . Desaulniers , A . Hertz , D . Huisman , A comparison of five heuristics for the multiple depot vehicle scheduling",
"url": "http://refhub.elsevier.com/S2352-3409(18)31594-4/sbref4"
},
{
"start_index": 0,
"text": "problem , J . Sched . 12 ( 1 )( 2009 ) 17",
"text": "problem , J . Sched . 12 ( 1 ) ( 2009 ) 17 .",
"url": "http://refhub.elsevier.com/S2352-3409(18)31594-4/sbref4"
}
],
Expand All @@ -1162,7 +1162,7 @@
"links": [
{
"start_index": 4,
"text": "C . C . Ribeiro , F . Soumis , Acolumngenerationapproachtothemultiple - depotvehicleschedulingproblem , Oper . Res . 42 ( 1",
"text": "C . C . Ribeiro , F . Soumis , A column generation approach to the multiple - depot vehicle scheduling problem , Oper . Res . 42 ( 1 )",
"url": "http://refhub.elsevier.com/S2352-3409(18)31594-4/sbref5"
},
{
Expand All @@ -1172,7 +1172,7 @@
},
{
"start_index": 0,
"text": "( 1994 ) 41 – 52",
"text": "( 1994 ) 41 – 52 .",
"url": "http://refhub.elsevier.com/S2352-3409(18)31594-4/sbref5"
}
],
Expand Down
Loading

0 comments on commit c5772f3

Please sign in to comment.