Opened 8 years ago

Closed 4 years ago

#1107 closed proposed-project (wontfix)

WWW::Mechanize-like package for Haskell

Reported by: nominolo@… Owned by: none
Priority: OK Keywords:
Cc: Difficulty: unknown
Mentor: not-accepted Topic: Networking

Description

Provide a framework that can serve as a basis for intelligent web agents / bots. This means it should provide means to simulate an interaction with a web site:

  • retrieving web-sites, handling forwarding, cookies and similar user-agent features
  • provide easy means to fill out forms or set up other kinds of requests
  • query documents, e.g. by tag, by id, by class, etc.; search for contents

A lot of functionality might already be available through other libraries and just has to be put together in a nice way.

[Of course this library can be used for things like spam-Bots, but I think there are a lot of legitimate applications, too ;) ]

Change History (5)

comment:1 Changed 7 years ago by nominolo

  • Priority set to OK

I think it's doable as a GSoC project, but working on basic network libraries (ByteString?-support, Unicode) is more likely to be accepted.

comment:2 Changed 6 years ago by gull

  • Owner changed from none to gull

comment:3 Changed 6 years ago by gull

  • Owner changed from gull to none

comment:4 Changed 6 years ago by eelco

Seems 'shpider' might fulfill this request: http://hackage.haskell.org/cgi-bin/hackage-scripts/package/shpider

comment:5 Changed 4 years ago by tibbe

  • Resolution set to wontfix
  • Status changed from new to closed

A little bit too specialized. To be really useful it also requires a student with good API design skills (which students tend to lack).

Note: See TracTickets for help on using tickets.