Skip to content

Commit

Permalink
0.0.7
Browse files Browse the repository at this point in the history
  • Loading branch information
j-mendez committed Nov 27, 2023
1 parent 2043c6e commit e6ccd14
Show file tree
Hide file tree
Showing 17 changed files with 37 additions and 17 deletions.
21 changes: 20 additions & 1 deletion README.md
Original file line number Diff line number Diff line change
@@ -1,4 +1,4 @@
# spider-nodejs
# spider-rs

The [spider](https://github.com/spider-rs/spider) project ported to nodejs via napi.

Expand Down Expand Up @@ -33,6 +33,25 @@ const { links, pages } = new crawl("https://rsseau.fr");
console.log(pages)
```

## Benchmarks

```sh
----------------------
mac Apple M1 Max
10-core CPU
64 GB of RAM memory
1 TB of SSD disk space
-----------------------

Test url: `https://rsseau.fr`

211 pages
```

| | `libraries` |
| :--------------------------------------- | :-------------------- |
| **`spider-rs: crawl 10 samples`** | `4s` (✅ **1.00x**) |
| **`crawlee: crawl 10 samples`** | `75s` (✅ **1.00x**) |

## Development

Expand Down
2 changes: 1 addition & 1 deletion npm/android-arm-eabi/package.json
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
{
"name": "@spider-rs/spider-rs-android-arm-eabi",
"version": "0.0.6",
"version": "0.0.7",
"repository": "https://github.com/spider-rs/spider-nodejs",
"os": [
"android"
Expand Down
2 changes: 1 addition & 1 deletion npm/android-arm64/package.json
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
{
"name": "@spider-rs/spider-rs-android-arm64",
"version": "0.0.6",
"version": "0.0.7",
"repository": "https://github.com/spider-rs/spider-nodejs",
"os": [
"android"
Expand Down
2 changes: 1 addition & 1 deletion npm/darwin-arm64/package.json
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
{
"name": "@spider-rs/spider-rs-darwin-arm64",
"version": "0.0.6",
"version": "0.0.7",
"repository": "https://github.com/spider-rs/spider-nodejs",
"os": [
"darwin"
Expand Down
2 changes: 1 addition & 1 deletion npm/darwin-universal/package.json
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
{
"name": "@spider-rs/spider-rs-darwin-universal",
"version": "0.0.6",
"version": "0.0.7",
"repository": "https://github.com/spider-rs/spider-nodejs",
"os": [
"darwin"
Expand Down
2 changes: 1 addition & 1 deletion npm/darwin-x64/package.json
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
{
"name": "@spider-rs/spider-rs-darwin-x64",
"version": "0.0.6",
"version": "0.0.7",
"repository": "https://github.com/spider-rs/spider-nodejs",
"os": [
"darwin"
Expand Down
2 changes: 1 addition & 1 deletion npm/freebsd-x64/package.json
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
{
"name": "@spider-rs/spider-rs-freebsd-x64",
"version": "0.0.6",
"version": "0.0.7",
"repository": "https://github.com/spider-rs/spider-nodejs",
"os": [
"freebsd"
Expand Down
2 changes: 1 addition & 1 deletion npm/linux-arm-gnueabihf/package.json
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
{
"name": "@spider-rs/spider-rs-linux-arm-gnueabihf",
"version": "0.0.6",
"version": "0.0.7",
"repository": "https://github.com/spider-rs/spider-nodejs",
"os": [
"linux"
Expand Down
2 changes: 1 addition & 1 deletion npm/linux-arm64-gnu/package.json
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
{
"name": "@spider-rs/spider-rs-linux-arm64-gnu",
"version": "0.0.6",
"version": "0.0.7",
"repository": "https://github.com/spider-rs/spider-nodejs",
"os": [
"linux"
Expand Down
2 changes: 1 addition & 1 deletion npm/linux-arm64-musl/package.json
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
{
"name": "@spider-rs/spider-rs-linux-arm64-musl",
"version": "0.0.6",
"version": "0.0.7",
"repository": "https://github.com/spider-rs/spider-nodejs",
"os": [
"linux"
Expand Down
2 changes: 1 addition & 1 deletion npm/linux-x64-gnu/package.json
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
{
"name": "@spider-rs/spider-rs-linux-x64-gnu",
"version": "0.0.6",
"version": "0.0.7",
"repository": "https://github.com/spider-rs/spider-nodejs",
"os": [
"linux"
Expand Down
2 changes: 1 addition & 1 deletion npm/linux-x64-musl/package.json
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
{
"name": "@spider-rs/spider-rs-linux-x64-musl",
"version": "0.0.6",
"version": "0.0.7",
"repository": "https://github.com/spider-rs/spider-nodejs",
"os": [
"linux"
Expand Down
2 changes: 1 addition & 1 deletion npm/win32-arm64-msvc/package.json
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
{
"name": "@spider-rs/spider-rs-win32-arm64-msvc",
"version": "0.0.6",
"version": "0.0.7",
"repository": "https://github.com/spider-rs/spider-nodejs",
"os": [
"win32"
Expand Down
2 changes: 1 addition & 1 deletion npm/win32-ia32-msvc/package.json
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
{
"name": "@spider-rs/spider-rs-win32-ia32-msvc",
"version": "0.0.6",
"version": "0.0.7",
"repository": "https://github.com/spider-rs/spider-nodejs",
"os": [
"win32"
Expand Down
2 changes: 1 addition & 1 deletion npm/win32-x64-msvc/package.json
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
{
"name": "@spider-rs/spider-rs-win32-x64-msvc",
"version": "0.0.6",
"version": "0.0.7",
"repository": "https://github.com/spider-rs/spider-nodejs",
"os": [
"win32"
Expand Down
2 changes: 1 addition & 1 deletion package.json
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
{
"name": "@spider-rs/spider-rs",
"version": "0.0.6",
"version": "0.0.7",
"main": "index.js",
"types": "index.d.ts",
"napi": {
Expand Down
3 changes: 2 additions & 1 deletion tsconfig.json
Original file line number Diff line number Diff line change
Expand Up @@ -2,6 +2,7 @@
"compilerOptions": {
"module": "commonjs",
"strict": true,
"lib": ["ES2015", "dom"]
"lib": ["ES2015", "dom"],
"skipLibCheck": true
}
}

0 comments on commit e6ccd14

Please sign in to comment.