How do you recognize if the collector has finished? If the site doesn't contain ... | Hacker News

Hacker News new | past | comments | ask | show | jobs | submit

login

asciimoo on Oct 5, 2017 | parent | context | favorite | on: Colly: Fast and Elegant Scraping Framework for Gol...

How do you recognize if the collector has finished? If the site doesn't contain "a" elements (e.g. because of a network error), this example would block forever.

dward on Oct 5, 2017 [–]

The producer closes the channel. This is differentiable from an open empty channel in a select.

asciimoo on Oct 5, 2017 | [–]

Makes sense, thanks =)

In the above example this would require `nil` checking of the retrieved value every time. I'm not sure if it would make the API cleaner

Consider applying for YC's Summer 2025 batch! Applications are open till May 13
Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact