Lucia,
Understood. My post was mainly in response to the thread in general where the question of whether robots.txt constitutes a copyright protection arose. That said, I think you could still find some clues regarding the question in the original post on this thread. The case seems to place importance on the fact that:
"Even if it the Harding firm knew that Healthcare Advocates did not give them permission to see its archived screenshots, lack of permission is not circumvention under the DMCA".
With the "lack of permission" issue off the table, by faking the user agent aren't they are basically just requesting the information without identifying themselves and receiving it? I can't see how that could be construed as circumvention under the DMCA.
I hope I am wrong, by the way. I'm not saying picscout isn't breaking any laws ... i just don't think they are violating the DMCA circumvention laws.
Lettered,
Other than with some pedantic nitpicking , I don't disagree with your interpretation of what the court might be saying about robots.txt.
But the reason I was saying that I don't think this is what buddhapi started out discussing is that in his introductory comment, he bolded this from the law:
It is also a crime under US law to use any trick or false information to gain access to a computer system. Running a robot that pretends to be a user by faking its useragent is crime under US Law because it is using false information to gain access to a computer system."
Notice the bit he quotes says nothing about robots.txt. It says something about faking a user agent.
What I'm going to say next has nothing to do with legalities. It has to do with nuts and bolts of running a web site:
Nothing needs to fake a user agent to get around robots.txt. This is because robots.txt is not a block. (In fact, the reason the court seems to recognize disobeying robots.txt isn't necessarily violating DMCA is that robots.txt is not really a block.)
Faking user agents is a way to get around a real, honest to goodness block like the kind in .htaccess on Apache. Also: In discussions above and on other thread, people have been talking about picscout faking useragents.
So while I think a case discussing robots.txt especially as it involves the Wayback machine is interesting, I think maybe people are getting distracted by an interesting discussion of robots.txt and forgetting about the issue of faking useragents.