Monitoring Websites with Python
An Unconventional Solution
Dec 25, 2022
Recently I missed a once-in-a-lifetime deal. I don’t regret it, but I decided to put a plan so that it doesn’t happen again. I had a snippet that monitors webpages for any change and reports back to me. However, it didn’t age well. It has a downside where it only excels on statics webpages which are a rarity nowadays.
After some time, serendipity stroke. I found a solution to overcome this hurdle. It’s entropy, and in information theory, it quantifies the similarities and differences between two things.
Here is my solution:
The Relative tolerance is the only variable that needs to be adjusted. It’s a threshold to tell the algorithm when a change in a dynamic webpage is significant.
What do you think of this solution?
