Skip to content

A simple python http-server mockup to test web crawler.

License

Notifications You must be signed in to change notification settings

YUChoe/HTTPserver-mock

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

3 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

PEP8

HTTPserver-mock

a simple http-server mockup to test web crawler.

Installation

Run the folowing to install:

pip install HTTPserver-mock

Usage

from src.HTTPserver_mock import HTTPserver_mock
import noizze_crawler as nc


@HTTPserver_mock()
def test_crawler():
    (title, desc, image_url, html) = nc.crawler('http://localhost:8000/index.html')
    print('title:', title)
    print('desc:', desc)
    print('image_url:', image_url)
    print('html:', html[:1000])


if __name__ == '__main__':
    test_crawler()
$ python test.py
127.0.0.1 - - [07/Nov/2019 13:34:55] "GET /index.html HTTP/1.1" 200 -
1573101292.684394 httpserver_mock started
<h2>nope</h2>
1573101296.704611 httpserver_mock finished

ChangeLog

  • v2: PyPI published
  • v1: Test alpha

License

MIT

About

A simple python http-server mockup to test web crawler.

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages