Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
188 commits
Select commit Hold shift + click to select a range
0d763f7
feat: iframe support for get element info
amhsirak Dec 20, 2024
6904933
feat: iframe support for getRect
amhsirak Dec 20, 2024
8ba928d
chore: fix format
amhsirak Dec 20, 2024
422b774
fix: browser window english language
RohitR311 Dec 23, 2024
e017148
fix: preserve previous labels steps before adding list step
RohitR311 Dec 23, 2024
4f151f0
Merge pull request #287 from getmaxun/listlang-fix
amhsirak Dec 23, 2024
e4ab1c3
Merge pull request #288 from getmaxun/labreset-fix
amhsirak Dec 23, 2024
e2bc45b
chore: -rm unique mode 1 log
amhsirak Dec 23, 2024
bc88aa8
chore: -rm non unique mode 2 log
amhsirak Dec 23, 2024
489b878
chore: -rm user.emal
amhsirak Dec 23, 2024
2c6f5b7
feat: better error message
amhsirak Dec 23, 2024
3776726
chore: -rm save log
amhsirak Dec 23, 2024
09aab83
chore: -rm settings log
amhsirak Dec 23, 2024
970a846
chore: -rm i18n logs
amhsirak Dec 23, 2024
84997a4
Merge pull request #289 from getmaxun/cleanup
amhsirak Dec 23, 2024
ecfd1e1
fix: bring back i18n logs
amhsirak Dec 23, 2024
ad8a48c
chore: add log warning
amhsirak Dec 23, 2024
2f83029
Merge pull request #290 from getmaxun/cleanup
amhsirak Dec 23, 2024
feb30b9
feat: add nth-child selectors for td tag
RohitR311 Dec 23, 2024
5ac88c6
feat: add scraping logic for tabular data in scrapeList
RohitR311 Dec 23, 2024
99ce03f
feat: robot name
amhsirak Dec 23, 2024
155a4c7
feat: robot name
amhsirak Dec 23, 2024
1c219c8
Merge pull request #292 from getmaxun/ui
amhsirak Dec 23, 2024
fed53fd
chore: -rm translated notification
amhsirak Dec 23, 2024
85381a4
chore: -rm translated error
amhsirak Dec 23, 2024
7650a21
chore: -rm lang switcher
amhsirak Dec 23, 2024
06d6891
chore: -rm lang switcher buttons
amhsirak Dec 23, 2024
a630c4c
chore: whitespace cleanup
amhsirak Dec 23, 2024
f929028
chore: whitespace cleanup
amhsirak Dec 23, 2024
5af6340
fix: format
amhsirak Dec 23, 2024
dc360f7
Merge pull request #293 from getmaxun/ui
amhsirak Dec 23, 2024
5939471
fix: move handleSave onClick to save button
amhsirak Dec 23, 2024
a150ecd
Merge pull request #294 from getmaxun/ui
amhsirak Dec 23, 2024
8f58caf
fix: avoid reload on duplicate robot cancel
amhsirak Dec 23, 2024
2fff0d2
Merge pull request #295 from getmaxun/ui
amhsirak Dec 23, 2024
b411faf
feat: add condition to ignore html and body tags on highlighting
RohitR311 Dec 24, 2024
3176fa2
feat: add loop to handle nested scraping
RohitR311 Dec 24, 2024
a131ce6
feat: shadow dom selection
amhsirak Dec 24, 2024
4d39db4
chore: add refs in urls
naveenpan09 Dec 25, 2024
5eecf6d
Merge pull request #297 from getmaxun/refs
amhsirak Dec 25, 2024
50bcd4b
feat: add logic to seperate table fields
RohitR311 Dec 25, 2024
641b655
fix: revert
amhsirak Dec 25, 2024
991b554
feat: revert non-table scraping logic
RohitR311 Dec 25, 2024
25a0d1a
Merge branch 'table-scrape' of https://github.com/getmaxun/maxun into…
RohitR311 Dec 25, 2024
33de0f1
feat: separate table and non-table data logic
RohitR311 Dec 25, 2024
31d9730
feat: add logic to match 70% classes
RohitR311 Dec 25, 2024
fcc71e0
feat: add limit to table scraping
RohitR311 Dec 25, 2024
97efd15
feat: add check for table highlighting
RohitR311 Dec 26, 2024
fe38f5a
feat: improve 70% class matching logic for scraping
RohitR311 Dec 26, 2024
8e2357d
Merge pull request #291 from getmaxun/table-scrape
amhsirak Dec 26, 2024
ae6b7bc
feat: english work email login
amhsirak Dec 26, 2024
f8575ac
feat: english work email register
amhsirak Dec 26, 2024
f9d0fe9
feat: german work email login
amhsirak Dec 26, 2024
fa12867
feat: german work email register
amhsirak Dec 26, 2024
0d51e75
feat: spanish work email login
amhsirak Dec 26, 2024
ca76a79
feat: spanish work email register
amhsirak Dec 26, 2024
800e193
feat: japanese work email login
amhsirak Dec 26, 2024
705408c
feat: japanese work email register
amhsirak Dec 26, 2024
230464d
feat: chinese simplified work email register
amhsirak Dec 26, 2024
25931aa
feat(translation): chinese simplified work email login
amhsirak Dec 26, 2024
4b12139
Merge pull request #298 from getmaxun/email-ui
amhsirak Dec 26, 2024
6ac3e19
feat: add del functionality for text and list steps
RohitR311 Dec 28, 2024
3cf0b85
feat: add lang translation for delete button
RohitR311 Dec 28, 2024
fd7e4ab
feat: check confirm capture and render delete button
RohitR311 Dec 28, 2024
0ba0839
feat: check confirm list capture and render delete button
RohitR311 Dec 28, 2024
293ddea
feat: emit highlighter on initial stage of capture list
RohitR311 Dec 29, 2024
d4b7cc1
feat: add back func to navigate across capture list stages
RohitR311 Dec 29, 2024
dead389
feat: add translation for back button of capture list action
RohitR311 Dec 29, 2024
a09b03e
feat: get deepest shadowDOM element selector
RohitR311 Dec 29, 2024
542f4d3
feat: change shadowDOM full selector path
RohitR311 Dec 29, 2024
b60f4b7
feat: add functionality to scrape shadowDOM elements
RohitR311 Dec 29, 2024
9f9dc4e
feat: add shadow optional field in SelectorObject
RohitR311 Dec 29, 2024
b696fa5
feat: add shadow param for scrapeSchema config
RohitR311 Dec 29, 2024
415ce02
feat: add shadow bool field to text step
RohitR311 Dec 29, 2024
1a6a481
feat: add shadow selectors field type
RohitR311 Dec 29, 2024
c303181
feat: prioritize returning shadow selector
RohitR311 Dec 29, 2024
cec2397
feat: change shadowDOM full selector path
RohitR311 Dec 29, 2024
05c7921
feat: add shadowInfo in highlighter data
RohitR311 Dec 29, 2024
40804fd
Merge pull request #299 from getmaxun/del-step
amhsirak Dec 30, 2024
3d999e0
Merge pull request #303 from getmaxun/list-back
amhsirak Dec 30, 2024
4031ded
feat: confirm instead of confirm pagination
amhsirak Dec 30, 2024
8baad8d
feat: confirm instead of confirm limit
amhsirak Dec 30, 2024
663a4fd
feat(spanish): confirm instead of confirm pagination
amhsirak Dec 30, 2024
aded4df
feat(spanish): confirm instead of confirm limit
amhsirak Dec 30, 2024
09b974c
feat(japanese): confirm instead of confirm pagination
amhsirak Dec 30, 2024
20b31f3
feat(japanese): confirm instead of confirm limit
amhsirak Dec 30, 2024
e78a611
feat(german): confirm instead of confirm pagination
amhsirak Dec 30, 2024
c753ce5
feat(german): confirm instead of confirm limit
amhsirak Dec 30, 2024
634daee
feat(chinese): confirm instead of confirm pagination
amhsirak Dec 30, 2024
cd7f38f
feat(chinese): confirm instead of confirm limit
amhsirak Dec 30, 2024
d2ab81e
feat: add logic to get deeply nested shadowDOM elements
RohitR311 Dec 30, 2024
9287c29
feat: rm host and element info for shadow selector
RohitR311 Dec 30, 2024
e952d8f
feat: add nested shadow-root scraping logic for scrapeSchema
RohitR311 Dec 30, 2024
b757d9c
feat: add func to rm shadow selectors from workflow
RohitR311 Dec 30, 2024
4b4074b
feat: add logic to scrape multiple nested shadow dom elements
RohitR311 Dec 30, 2024
6474efd
Merge pull request #304 from getmaxun/confirm-ui
amhsirak Dec 30, 2024
4a09ea6
feat: get deepest element rect coordinates
RohitR311 Dec 31, 2024
4c0ad3c
fix: avoid ui shift on api key reveal
amhsirak Dec 31, 2024
a3337d7
fix: format
amhsirak Dec 31, 2024
42e1306
feat: add shadowDOM support for capture list selector generation
RohitR311 Jan 1, 2025
c6105b4
feat: generate highlighter for shadoDOM and mixedDOM elements
RohitR311 Jan 1, 2025
8db6279
feat: add shadowDOM support for scraping list
RohitR311 Jan 1, 2025
e4ffef5
Merge pull request #307 from getmaxun/confirm-ui
amhsirak Jan 1, 2025
24915a9
feat: get notify from global info store
amhsirak Jan 1, 2025
8c2b924
feat: notify on schedule delete
amhsirak Jan 1, 2025
e617988
fix: revert local maxun-core changes
amhsirak Jan 1, 2025
9b2ea1f
chore: cleanup space
amhsirak Jan 1, 2025
cc6cc8f
fix: format
amhsirak Jan 1, 2025
6d25079
fix: format
amhsirak Jan 1, 2025
3b9e30d
fix: format
amhsirak Jan 1, 2025
52aefd1
fix: format
amhsirak Jan 1, 2025
0a0c6ac
Merge pull request #309 from getmaxun/robot-sort
amhsirak Jan 1, 2025
735b33b
fix: typo
amhsirak Jan 1, 2025
22a99ff
fix: twitter typo
amhsirak Jan 1, 2025
863dc8e
Merge pull request #310 from getmaxun/robot-sort
amhsirak Jan 1, 2025
bd6bef9
Merge pull request #308 from getmaxun/confirm-ui
amhsirak Jan 2, 2025
c287340
feat: shadowDOM support for table and non table list scraping
RohitR311 Jan 2, 2025
ec0bc75
docs: update website to maxun.dev
amhsirak Jan 2, 2025
9394fc3
Merge pull request #312 from getmaxun/robot-sort
amhsirak Jan 2, 2025
b6faf5c
feat: add iframeSelector generation logic for capture text
RohitR311 Jan 2, 2025
3f54f11
Merge branch 'develop' into shadow-dom
RohitR311 Jan 2, 2025
8323593
chore: format
amhsirak Jan 2, 2025
5813ae4
Merge branch 'shadow-dom' of https://github.com/getmaxun/maxun into s…
amhsirak Jan 2, 2025
e91a391
chore: cleanup console logs
amhsirak Jan 2, 2025
edfcd8f
fix: format
amhsirak Jan 2, 2025
af237ba
fix: update custom limit if value >= 1
RohitR311 Jan 3, 2025
35a44bb
fix: rm translation for alt maxun_logo
RohitR311 Jan 3, 2025
1874e71
fix: add translation for same name robot creation
RohitR311 Jan 3, 2025
3f73a48
feat: add nested iframe selector generation func for capture text
RohitR311 Jan 4, 2025
9eb4ec3
feat: add iframe selector type for selectors
RohitR311 Jan 4, 2025
2943681
feat: prioritize returning iframe selector if exists
RohitR311 Jan 4, 2025
360fe63
feat: get deeply nested iframe element info
RohitR311 Jan 4, 2025
0eb9a8f
feat: improve rect generation for iframe elements
RohitR311 Jan 4, 2025
a845509
feat: add iframe support for scrapeSchema action
RohitR311 Jan 4, 2025
222cc63
Merge pull request #316 from getmaxun/lang-fixes
amhsirak Jan 4, 2025
170e4f1
Merge pull request #315 from getmaxun/cuslim-fix
amhsirak Jan 4, 2025
7018ba6
feat: improve non unique selector generation for capture list
RohitR311 Jan 4, 2025
ed1ea41
feat: add iframe support for child selector generation
RohitR311 Jan 4, 2025
1c13a23
feat: add iframe support for highlighter logic
RohitR311 Jan 4, 2025
230f40b
feat: monitor web recorder performance
amhsirak Jan 4, 2025
96049e3
feat: add iframe support for table and non table scraping
RohitR311 Jan 4, 2025
7b08471
feat: add func to rm iframe selector from workflow
RohitR311 Jan 4, 2025
5e775fa
Merge branch 'develop' into iframe
RohitR311 Jan 4, 2025
e20a407
feat: monitor web recorder frontend performance
amhsirak Jan 4, 2025
0da5cb0
feat: monitor web recorder backend performance
amhsirak Jan 4, 2025
10bf769
Merge pull request #296 from getmaxun/shadow-dom
amhsirak Jan 4, 2025
d1e8239
Merge branch 'develop' into iframe
RohitR311 Jan 4, 2025
c132f27
Merge pull request #275 from getmaxun/iframe
RohitR311 Jan 4, 2025
934ffbb
fix: return iframeSelector if present
RohitR311 Jan 4, 2025
9c8a980
feat: add deep nested iframe scraping support for capture text
RohitR311 Jan 4, 2025
5058a3b
Merge pull request #320 from getmaxun/shadow-iframe
RohitR311 Jan 4, 2025
e74616a
feat: reduce memory usage by canvas
amhsirak Jan 5, 2025
f26718f
feat: decreasing memory trend & latency
amhsirak Jan 5, 2025
ba0d849
feat: higher fps & latency less than 5ms
amhsirak Jan 5, 2025
2a568ed
chore: cleanup
amhsirak Jan 5, 2025
b06db2e
chore: lint
amhsirak Jan 5, 2025
bc59ae5
chore(deps): install lodash & sharp
amhsirak Jan 6, 2025
20912a7
fix: missing coordinates interface export
amhsirak Jan 6, 2025
7fba807
feat: screenshot queue
amhsirak Jan 6, 2025
b3f17bc
feat: memory management for screenshot streaming
amhsirak Jan 6, 2025
9d09647
feat: perform memory cleanup
amhsirak Jan 6, 2025
d79b2fd
feat: memory management config
amhsirak Jan 6, 2025
65c30c0
feat: screencast config
amhsirak Jan 6, 2025
60131e1
feat: optimize screenshot
amhsirak Jan 6, 2025
c766df6
feat: emit screenshot using screenshot queue
amhsirak Jan 6, 2025
8c80d5c
feat: start/stop screencast
amhsirak Jan 6, 2025
6521eac
feat: set screencast type as jpeg | png
amhsirak Jan 6, 2025
d25ffe3
feat: change screencast config
amhsirak Jan 6, 2025
9cfffd8
chore: lint
amhsirak Jan 6, 2025
d33a064
feat: set screenshot queue empty while switch off
amhsirak Jan 6, 2025
4e7ce63
chore: lint
amhsirak Jan 6, 2025
82e24f9
feat: disable browser performance monitoring
amhsirak Jan 6, 2025
9b920a1
feat: temporarily disable browser performance monitoring
amhsirak Jan 6, 2025
5ddfc91
chore: remove unused import
amhsirak Jan 6, 2025
0497653
feat: disable canvas events performance monitoring
amhsirak Jan 6, 2025
de2ddfd
fix: missing dropdown
amhsirak Jan 6, 2025
66c964f
feat: remove throttle wrapper from emit screenshot
amhsirak Jan 6, 2025
434409e
chore: lint
amhsirak Jan 6, 2025
2d79591
chore(deps): use maxun-core 0.0.7
amhsirak Jan 6, 2025
50ca6cc
Merge pull request #313 from getmaxun/performance
amhsirak Jan 6, 2025
1ab4631
feat: handle select tags in getElementInfo
amhsirak Jan 6, 2025
c86fdf8
feat: handle input tags in getElementInfo
amhsirak Jan 6, 2025
ad959d1
Merge pull request #322 from getmaxun/inputs-select
amhsirak Jan 6, 2025
e87a7be
chore: maxun-core 0.0.8
amhsirak Jan 7, 2025
ee38856
Merge branch 'develop' of https://github.com/getmaxun/maxun into develop
amhsirak Jan 7, 2025
4d73342
chore(deps): upgrade maxun-core -> 0.0.8
amhsirak Jan 7, 2025
56b17a4
chore: v0.0.6
amhsirak Jan 7, 2025
73d4497
chore: BE 0.0.10, FE 0.0.6
amhsirak Jan 7, 2025
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
8 changes: 4 additions & 4 deletions README.md
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
<h1 align="center">
<div>
<a href="https://maxun-website.vercel.app/">
<a href="https://maxun-website.vercel.app/?ref=ghread">
<img src="/src/assets/maxunlogo.png" width="50" />
<br>
Maxun
Expand All @@ -15,11 +15,11 @@ Maxun lets you train a robot in 2 minutes and scrape the web on auto-pilot. Web


<p align="center">
<a href="https://maxun-website.vercel.app/"><b>Website</b></a> |
<a href="https://www.maxun.dev/?ref=ghread"><b>Website</b></a> |
<a href="https://discord.gg/5GbPjBUkws"><b>Discord</b></a> |
<a href="https://x.com/maxun_io"><b>Twitter</b></a> |
<a href="https://x.com/maxun_io?ref=ghread"><b>Twitter</b></a> |
<a href="https://docs.google.com/forms/d/e/1FAIpQLSdbD2uhqC4sbg4eLZ9qrFbyrfkXZ2XsI6dQ0USRCQNZNn5pzg/viewform"><b>Join Maxun Cloud</b></a> |
<a href="https://www.youtube.com/@MaxunOSS"><b>Watch Tutorials</b></a>
<a href="https://www.youtube.com/@MaxunOSS?ref=ghread"><b>Watch Tutorials</b></a>
<br />
<br />
<a href="https://trendshift.io/repositories/12113" target="_blank"><img src="https://trendshift.io/api/badge/repositories/12113" alt="getmaxun%2Fmaxun | Trendshift" style="width: 250px; height: 55px; margin-top: 10px;" width="250" height="55"/></a>
Expand Down
4 changes: 2 additions & 2 deletions docker-compose.yml
Original file line number Diff line number Diff line change
Expand Up @@ -43,7 +43,7 @@ services:
#build:
#context: .
#dockerfile: server/Dockerfile
image: getmaxun/maxun-backend:v0.0.9
image: getmaxun/maxun-backend:v0.0.10
ports:
- "${BACKEND_PORT:-8080}:${BACKEND_PORT:-8080}"
env_file: .env
Expand All @@ -70,7 +70,7 @@ services:
#build:
#context: .
#dockerfile: Dockerfile
image: getmaxun/maxun-frontend:v0.0.5
image: getmaxun/maxun-frontend:v0.0.6
ports:
- "${FRONTEND_PORT:-5173}:${FRONTEND_PORT:-5173}"
env_file: .env
Expand Down
2 changes: 1 addition & 1 deletion maxun-core/package.json
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
{
"name": "maxun-core",
"version": "0.0.7",
"version": "0.0.8",
"description": "Core package for Maxun, responsible for data extraction",
"main": "build/index.js",
"typings": "build/index.d.ts",
Expand Down
Loading