First, set TOR’s authentication method to “Password”. If you have installed TOR as part of the Vidalia bundle you can find this option in the Advanced tab of the Settings window. Choose any password you like and make sure you memorize it. Note : don’t tick the box that says Randomly Generate (if you do the program won’t tell you what password it generated).

You need to restart TOR for the changes to take effect. In Vidalia you can do this by first clicking “Stop Tor”, followed by “Start Tor”.

Now all that is left is configuring GTrends SE to enable automatic identity switching. Head to Settings/Proxies and tick “Automatically switch to new identity when needed”. Enter the TOR password in the appropriate box. Also make sure that “Use a proxy” is checked and TOR’s proxy address (usually 127.0.0.1:8118) is in the proxy list. Finally, uncheck “Automatically pause if getting Forbidden results” in Settings/Speed.

Click OK. You’re set

Notes

• I recommend removing all other proxies (except TOR) from the proxy list when enabling identity switching.
• GTrends SE expects the TOR control port to be at 127.0.0.1:9051. At this time the address is hardcoded and can’t be changed. Automatic identity switching will not work if TOR is not running on localhost and/or the control port number is different.
• If an identity doesn’t work , GTrends SE will wait 15 seconds before trying again and switching to a new one. This delay was added to account for slower network connections where it takes a while to get a new identity.
• You can probably disable “Play sound if blocked by Google” now (if you wish).

Details and a download link can be found here.

The script is fairly basic, but it might be useful for those interested in a web-based, free alternative to GTrends SE. The PHP script uses a slightly different algorithm (the results might be unexpected…) and requires a Google account. You will need some basic webserver administration/PHP skills to set it up.

The search volume is calculated by comparing it to the reference keyword (Settings -> Criteria -> Reference keyword). The program sends a query with both keywords to Google Trends and calculates the searches based on the ratio of the reference/unknown keyword bar graphs. The keyword phrase that needs to be checked is wrapped in “quotes”.

The equation is something like this :
keyword_searches = ( keyword_bar_size / reference_bar_size ) * reference_searches

Pretty simple, right?

There’s one curious implication this algorithm has - for keywords that have very small search volume, it will always report the exact same (small) number of searches. The exact figure produced depends on the reference keyword and how many searches it has.

You get those similar results because Google Trends shows 1-pixel graph bars for those keywords (keyword_bar_size = 1). Trends will even show those 1-pixel bars for keywords that don’t get any searches at all. Obviously, plugging this value (1) into the above equation, you will always get the same result.

So if you notice lots of keywords with the same small number in the “Searches”, blame Google Trends, okay?

Therefore, I just uploaded a new version, which uses a different keyword.

Note that if you already have GTrends SE installed, downloading the new version will not automatically change your ref. keyword (this is by design). You need to change it manually by clicking “Settings” and entering a keyword and searches/day in the “Reference keyword” panel. I recommend you find your own baseline keyphrase, but, if you really don’t have a keyword to use, ask me (I won’t put the keyphrase in public here so that it doesn’t get abused).

My hosting provider is having some technical issues with email, so I’m afraid I won’t be able to use the newsletter to notify people about this change.

In this tutorial I’ll explain how to prevent this block. Google’s proprietary detection algorithms are hard to fool, but the tricks I’ll mention below should be effective for most users.

Use longer Google grace period

The “grace period” is how long the application will wait between consecutive requests. Longer grace period = less likely to be blocked. 12 to 16 seconds work well in most cases. The setting is found under Settings -&gt Speed. Note that you can safely set the Google Trends grace period to a lower value (e.g. 2 seconds) to compensate for any loss in speed.

Enable “Always check searches first, competition second”.

This option works very well together with the next trick, below.

Use “Negative thresholds“.

The idea is to decrease the number of searches that GTrends SE needs to do by quickly eliminating worthless keywords. This helps decrease the time needed to process a list of keywords and decreases the chances of getting a Google ban.

You can find this feature under Settings -&gt Criteria. Make sure the “Enable this feature” box is checked, set “Action” to “Don’t check the keywords any further” and set the “Less than X searches per day” value as high as you can afford to. For example, if you set it to “70 searches per day”, keywords that have less than 70 searches/day will not be fully checked - GTrends SE will stop analyzing those keywords as soon as the number of searches is determined.

There are no explicit rules on what numbers you should set in the “Negative threshold” section - choose what makes sense for the niche you’re researching.

Get a good proxy

Using an anonymous proxy is a very effective way to avoid being blocked by Google (though you need to switch the proxies now and then so that the proxies themselves don’t get banned). The real challenge is finding a good proxy - most of the freely available ones are of dubious quality and may have been already banned, even before you try to use them. I’ve already written a few posts on this topic :

How to configure GTrends SE to use a proxy
Another tutorial on GTrends SE and proxies (includes links to some proxy sites)

While a few users have had success with commercial, subscription-based proxy providers, I’m reluctant to recommend a specific site. A few Google searches will likely turn up a number of proxy services - e.g. Socksify - use at your own risk.

What It Is

This feature allows you to set a threshold (both for searches and competition) and apply special treatment to keywords that are below that threshold. You can make GTrends SE remove those keyword phrases from the list automatically, or not analyze them any further, or don’t do anything special except stating “Below Threshold” in the Verdict column. This frees up resources and can significantly decrease the time required to process a keyword list.

Negative Threshold Settings

You can configure the threshold options in the Settings window, under the Criteria tab. Here’s how they look :

And here’s what they mean :

• Enable this feature - check this to enable this feature. If it’s not enabled none of the other options mentioned below will have any effect.
• Less than X searches per day - the search threshold. Keywords that have less than this many searches will be considered below threshold. The default is 10, and you can enter 0 (zero) to ignore the number of searches a keyword has.
• More than X phrase-matching results in Google - the competition threshold. Keywords that have more than this amount of competition will be considered below threshold. The default is 100 000 (which is quite a lot), and you can enter 0 (zero) to ignore this part of the threshold calculation.
• Action - what to do with keywords that are below threshold. There are three possibilities here, all are pretty self-explanatory :
  • Just mark the keywords as below threshold.
  • Don’t check the keywords any further.
  • Delete the keywords.

  Choose whichever suits you best. The default is “Don’t check the keywords any further” - a middle-ground option that is faster than just marking the below-threshold keywords and safer than deleting them outright.

Choosing the exact settings is a matter of personal preference and what is needed in the current situation. Setting the search threshold higher and/or lowering the competition threshold number will cut off more useless keywords and make the research process faster.

On the other hand, if you use a very “aggressive” threshold configuration you might miss some potentially good keywords that just didn’t make it. Therefore I advise that you use a threshold that is more lenient than your good keyword criteria.

Notes

All Verdict values are recalculated when a keyword list is loaded from a file, and any configured threshold action will take effect immediately. This has one important implication - if you have set the Action to “Delete the keywords” and you load a keyword list that has some below threshold keywords, those keywords will not be loaded.

Another thing to note is that if you change the threshold settings while GTrends SE is running, it will only affect any newly checked keywords. Known verdicts will not be updated. If you want to recalculate them, you can either save the keyword list to a file and reload it, or select they keywords, right-click them and choose “Recheck keywords” from the popup menu (re-checking them can take a while).

Well, that explain how to use this feature to speed up your keyword research process

Now, lets see how GTrends SE has been improved…

It’s Faster

How about getting more work done in the same time? The main new feature in this release is the “negative treshold” option. In essence, this feature allows you to set a treshold (both for searches and competition) and apply special treatment to keywords that are below that treshold. You can make GTrends SE remove those keyword phrases from the list automatically, or simply not analyze them any further. This frees up resources and can significantly decrease the time required to process a keyword list.

Here’s an example - lets say you set the search treshold to “Less than 10 searches per day” and the action to perform to “Don’t check the keywords any further”. As soon as the tool discovers that a keyword has only 5 searches/day, it will mark the keyword as “Below Treshold” and move on to checking other keyword phrases. It won’t waste time looking up competition data for a keyword that is useless to you.

You can configure this feature in the “Criteria” tab of the “Settings” window. And don’t worry, I’ll post a proper tutorial soon

On a related note, there’s now a “Speed” tab as well, which gives you greater ability to fine-tune speed-related aspects of GTrends SE.

It’s More Reliable

Not to say that it wasn’t reliable before , but the new version has had several bugs fixed. For example, when adding keywords, GTrends SE will now automatically filter out commas and other special characters. This will prevent the application from repeatedly trying (and failing) to process an invalid keyword.

Furthermore, the treshold feature, in conjunction with proper speed settings, should eliminate most of the “Forbidden” errors that some users have been getting. This is because the negative treshold can significantly decrease the number of searches GTrends SE has to do, thus ensuring it doesn’t look as suspicious to Google. I still recommend to keep the Google grace period to 7 or more seconds (though feel free to experiment if you want).

It’s More Customizable

In addition to the new options mentioned above, you can even set the colors that are used to highlight good/not good/below treshold keywords. You can find all appearance-related settings in the “View” tab of the “Settings” window.

Anything else?

By popular request, I’ve added the ability to re-check selected keywords - you can right-click the keyword list and select the aptly named “Recheck keywords” command from the popup menu.

There are probably other things I forgot to mention here, small interface changes, simple fixes and so on. Go and see for yourself

P.S.
Don’t forget to sign up for the newsletter!

I looked around for a solution and made a few minor changes to GTrends SE to make this blocking slightly less likely. I also modified it to show “Forbidden” instead of “Error” when you hit a temporary block, so you know what the problem is. Get the new version.

The solution to these errors is to use a proxy. You can find lists of free proxies on the sites below :

Proxy4Free - I myself am currently using a proxy on this site.
ProxyList “fast proxies” - this site has several lists of proxies; the link goes to the list of “fast” proxies that also shows the uptime. You can use this parameter to determine how reliable a proxy is.

How to use a proxy with GTrends SE.

Another possibility is to install the TOR package (freeware) and use the address 127.0.0.1:8118 as the proxy address. Then you can switch proxies just by clicking the appropriate system tray icon and selecting “New Identity” from the popup menu.

I’d also recommend to increase the Grace period value in the GTrends SE Settings menu.

I implemented two new features that were suggested by users -

Launch new instance
Now you can open more than one GTrends SE window. You can do this using the aptly named “Launch new instance” Start Menu shortcut. Note that as a tradeoff windows opened in this manner will not be able receive keywords from the Keyword Grabber extension.

Here’s a bit of info for the technically inclined - the new shortcut launches gtrends.exe with a /new_instance parameter. GTrends SE also supports another parameter - /add_clipboard - that will cause the tool to attempt to get keywords from the clipboard.

Searches vs Competition ratio display
GTrends SE can calculate and display this ratio in a new column on the main screen. You can enable this feature by checking the “Display ratio” box in the Settings dialog.

The ratio is calculated as Ratio = (Searches ^ 2) / Competition, which is consistent with the original definition of Keyword Effectiveness Index.

Check Use a proxy and enter the proxy’s address in the Proxy box. The address should be in the form IP:PORT. “IP” is the unique numerical address of a server. If the address you usually use is a domain name, you can find the IP using this free tool.

The Username and Password boxes are just that. Leave them empty if your proxy doesn’t require a username/password.

Proxy settings take effect starting with the next keyword that is checked (yes, this means that if you set a proxy when GTrends SE is already processing a list of keywords, it will switch to using the proxy even if it’s only halfway through the list).