Pages in topic:   < [1 2 3 4 5]
The "Visitors" tab of your profile and search engine robots
Thread poster: Andreas Nieckele
Jessica Noyes
Jessica Noyes  Identity Verified
United States
Local time: 16:33
Member
Spanish to English
+ ...
Check boxes for deletion Oct 10, 2012

I am with Marina.
Whether they are bots or not, exactly, we should be able to delete 10 or more visits at a time with easy checkboxes and one click. As it is now, I have to slowly go through them, one at a time, confirm that I want to delete them, and then scroll down to the next one. The number of my bots has increased steeply recently. I am glad they are visiting, helping me keep a solid presence on search engines, but for some reason I don't want them cluttering up my visitors' log. ... See more
I am with Marina.
Whether they are bots or not, exactly, we should be able to delete 10 or more visits at a time with easy checkboxes and one click. As it is now, I have to slowly go through them, one at a time, confirm that I want to delete them, and then scroll down to the next one. The number of my bots has increased steeply recently. I am glad they are visiting, helping me keep a solid presence on search engines, but for some reason I don't want them cluttering up my visitors' log.
Tech people? Is this an easy change? Is there any reason not to simplify this process? Thanks
Collapse


 
Lucia Leszinsky
Lucia Leszinsky
SITE STAFF
Developers will evaluate different possibilities Oct 10, 2012

Jessica Noyes wrote:

I am with Marina.
Whether they are bots or not, exactly, we should be able to delete 10 or more visits at a time with easy checkboxes and one click. As it is now, I have to slowly go through them, one at a time, confirm that I want to delete them, and then scroll down to the next one. The number of my bots has increased steeply recently. I am glad they are visiting, helping me keep a solid presence on search engines, but for some reason I don't want them cluttering up my visitors' log.
Tech people? Is this an easy change? Is there any reason not to simplify this process? Thanks


Thanks for the suggestion, Jessica. Site developers will evaluate different possibilities. I will post back here as soon as I have any news.

Lucia


 
Zea_Mays
Zea_Mays  Identity Verified
Italy
Local time: 22:33
English to German
+ ...
Difficult task :-D Oct 16, 2012

Lucia Leszinsky wrote:

As explained in my previous reply, in such cases, support staff --together with site developers-- check visits in detail before taking action (i.e. marking an IP as a crawler IP). For this reason, I kindly ask you to please submit a support request with relevant details if you believe that you are receiving visits from web crawlers. Thanks!

Lucia

Today I found two (!) pages of crowler IP addresses (it seems all from Google). They can't be all sent to the support staff, seriously.

As said before I am _sure_ there is a way to hide the bots.

What's about the/a browscap.ini for example?
http://browsers.garykeith.com/

As for Jessicas suggestion I fully agree.


 
Robert Forstag
Robert Forstag  Identity Verified
United States
Local time: 16:33
Spanish to English
+ ...
Agree with Marina and Jessica Oct 17, 2012

As far as I can see, about 85% of my "visits" are from crawlers. About 3-4 years ago, this site had a fairly effective system of filtering out such visits. I wonder why this system was either changed or somehow has come to lose all effectiveness.



[Edited at 2012-10-17 00:17 GMT]


 
Christel Zipfel
Christel Zipfel  Identity Verified
Local time: 22:33
Italian to German
+ ...
The visitors tab is again overcrowded with crawlers' visits Mar 21, 2013

Since yesterday, my profile has been visited by nearly 100 crawlers. I had to go back four (!!!) pages before finding the first human visitor again.

Shouldn't this have been fixed a while ago? Or is this a bug and/or am I the only one having this problem? It would be great if the staff could solve this problem definitively!


 
Ambrose Li
Ambrose Li  Identity Verified
Canada
Local time: 16:33
English
+ ...
I really don’t understand why this is so hard to fix Mar 21, 2013

I can’t verify how bad the problem is right now since I let my paid membership lapse, but crawlers had always dominated the visitor log, so this is not a recent problem.

I really can’t understand why ProZ is unable to tell the crawlers from the real humans. It’s not like they have to do a whois lookup or Geo-IP lookup of IP addresses for every visit; all the major crawlers outright announce themselves. There really is no excuse in putting Google or Bing crawler visits
... See more
I can’t verify how bad the problem is right now since I let my paid membership lapse, but crawlers had always dominated the visitor log, so this is not a recent problem.

I really can’t understand why ProZ is unable to tell the crawlers from the real humans. It’s not like they have to do a whois lookup or Geo-IP lookup of IP addresses for every visit; all the major crawlers outright announce themselves. There really is no excuse in putting Google or Bing crawler visits in the normal visitors tab.

So I’ll really appreciate a technical explanation (the more technical, the better) of why this has been happening and for so long.
Collapse


 
Christel Zipfel
Christel Zipfel  Identity Verified
Local time: 22:33
Italian to German
+ ...
Indeed, this thread started in 2009 Mar 22, 2013

Ambrose Li wrote:

I really can’t understand why ProZ is unable to tell the crawlers from the real humans. It’s not like they have to do a whois lookup or Geo-IP lookup of IP addresses for every visit; all the major crawlers outright announce themselves. There really is no excuse in putting Google or Bing crawler visits in the normal visitors tab.

So I’ll really appreciate a technical explanation (the more technical, the better) of why this has been happening and for so long.


and this nuisance hasn't yet been fixed. We still continue to see more or less crawlers visiting every day our profile. I don't neither understand how this can be possible for a site that claims to be "for professionals" and the membership (only members can see their visitors tab) isn't free.

[Bearbeitet am 2013-03-22 09:25 GMT]


 
Suzan Hamer
Suzan Hamer  Identity Verified
Netherlands
Local time: 22:33
English
+ ...
Hear, hear. Mar 22, 2013

Christel Zipfel wrote:

Ambrose Li wrote:

I really can’t understand why ProZ is unable to tell the crawlers from the real humans. ...So I’ll really appreciate a technical explanation (the more technical, the better) of why this has been happening and for so long.


Indeed, this thread started in 2009... and this nuisance hasn't yet been fixed. We still continue to see more or less crawlers visiting every day our profile. I don't neither understand how this can be possible for a site that claims to be "for professionals" and the membership (only members can see their visitors tab) isn't free.

[Bearbeitet am 2013-03-22 09:25 GMT]


 
Yaotl Altan
Yaotl Altan  Identity Verified
Mexico
Local time: 15:33
Member (2006)
English to Spanish
+ ...
A map. May 11, 2013

I think it would be better a google-like map, as the location map we have in our profiles.

 
Jessica Noyes
Jessica Noyes  Identity Verified
United States
Local time: 16:33
Member
Spanish to English
+ ...
New crawler from Netherlands? Sep 7, 2013

I am getting a lot of visits from a series of similar numbers that start 5.10.83.## - from a place called Badhoevedorp in the Netherlands. First I thought someone there was interested in my work, but after 40 or more visits they haven't yet made up their mind. Does anyone know if this is a crawler?
Oh yes, and I am "still" hoping that if there is no way to keep crawler visits from showing up in our list, there will at least be a way to delete several of them at once.


 
Christel Zipfel
Christel Zipfel  Identity Verified
Local time: 22:33
Italian to German
+ ...
Yes, I noticed them too Sep 7, 2013

Jessica Noyes wrote:

I am getting a lot of visits from a series of similar numbers that start 5.10.83.## - from a place called Badhoevedorp in the Netherlands. First I thought someone there was interested in my work, but after 40 or more visits they haven't yet made up their mind. Does anyone know if this is a crawler?
Oh yes, and I am "still" hoping that if there is no way to keep crawler visits from showing up in our list, there will at least be a way to delete several of them at once.


I have got three visits of them only today.

Maybe the problem of crawlers showing up in our profile is too hard to solve for the staff. I read they have been working to fix it since several years.


 
Marina Soldati
Marina Soldati  Identity Verified
Argentina
Local time: 18:33
Member (2005)
English to Spanish
+ ...
Almost a year Sep 15, 2013

Hi All!

Almost a year has passed since Lucia´s last post: Developers will evaluate...
Are they still evaluating?

Really, today I have 6 visits in a row from a IP address (66.249.66.xxx) that belongs to Google Inc.
I would be so easy to mark the corresponding check boxes and hide them all at once. But no, you have to click on the Hide this visitor option, wait for the page to refresh for each one of them.

Come on! Why don´t you just delete the
... See more
Hi All!

Almost a year has passed since Lucia´s last post: Developers will evaluate...
Are they still evaluating?

Really, today I have 6 visits in a row from a IP address (66.249.66.xxx) that belongs to Google Inc.
I would be so easy to mark the corresponding check boxes and hide them all at once. But no, you have to click on the Hide this visitor option, wait for the page to refresh for each one of them.

Come on! Why don´t you just delete the Visitors tab? It´s really useless in this way.

Regards,
Marina

PS: sorry for any mistakes, I´m not a native speaker of English.
Collapse


 
Maria Kopnitsky
Maria Kopnitsky  Identity Verified
United States
Spanish to English
+ ...
Visitors tab updated Sep 19, 2013

Hello all,

I'm happy to announce that several updates have been made to the Visitors tab based on the feedback provided in this forum thread and elsewhere on the site. It is now possible to:

- Select multiple IP addresses at the same time to filter
- Filter a range of similar IP addresses based on small or large subnets
- See exactl
... See more
Hello all,

I'm happy to announce that several updates have been made to the Visitors tab based on the feedback provided in this forum thread and elsewhere on the site. It is now possible to:

- Select multiple IP addresses at the same time to filter
- Filter a range of similar IP addresses based on small or large subnets
- See exactly which IP addresses you have filtered

The mechanism that detects crawler visits has also been improved, so there should be fewer of those visits in the "Visitors" section of that tab. Rather, most of those visits should now appear in the "Search engines" tab.

I hope this helps. Please let me know if you have any questions about these updates.

Best regards,

Maria
Collapse


 
Marina Soldati
Marina Soldati  Identity Verified
Argentina
Local time: 18:33
Member (2005)
English to Spanish
+ ...
Thank you! Sep 19, 2013

Maria Kopnitsky wrote:

Hello all,

I'm happy to announce that several updates have been made to the Visitors tab based on the feedback provided in this forum thread and elsewhere on the site. It is now possible to:

- Select multiple IP addresses at the same time to filter
- Filter a range of similar IP addresses based on small or large subnets
- See exactly which IP addresses you have filtered

The mechanism that detects crawler visits has also been improved, so there should be fewer of those visits in the "Visitors" section of that tab. Rather, most of those visits should now appear in the "Search engines" tab.

I hope this helps. Please let me know if you have any questions about these updates.

Best regards,

Maria


So far, it works fine.

Best regards,
Marina


 
Suzan Hamer
Suzan Hamer  Identity Verified
Netherlands
Local time: 22:33
English
+ ...
Wonderful! At LAST!! Sep 20, 2013

Thank you VERY much. So far seems to be working well.

 
Pages in topic:   < [1 2 3 4 5]


To report site rules violations or get help, contact a site moderator:


You can also contact site staff by submitting a support request »

The "Visitors" tab of your profile and search engine robots






Protemos translation business management system
Create your account in minutes, and start working! 3-month trial for agencies, and free for freelancers!

The system lets you keep client/vendor database, with contacts and rates, manage projects and assign jobs to vendors, issue invoices, track payments, store and manage project files, generate business reports on turnover profit per client/manager etc.

More info »
TM-Town
Manage your TMs and Terms ... and boost your translation business

Are you ready for something fresh in the industry? TM-Town is a unique new site for you -- the freelance translator -- to store, manage and share translation memories (TMs) and glossaries...and potentially meet new clients on the basis of your prior work.

More info »