Failed to load Page during multi-threaded runs only [SOLVED]
-
My script seems to work fine while I am in the editor, however as soon as I try to run multi-threaded execution I get nothing but failed to load page errors.
I am using rotating data-center proxies. Anyone have this issue?
Quick Edit: It appears to be working perfectly fine as a single threaded process...
-
Proxies anonymous? what's the page?
-
The page is pornhub.com/signup and I'm not sure what you mean by proxies anonymous?
-
yea, so the bot works fine single threaded but the instant I try to multi-thread I get this.
[499752268] [14:39:29] Thread #7 : Thread ended with message "Failed to load page https://www.pornhub.com/signup"
[499752268] [14:39:29] Thread #10 : Thread ended with message "Failed to load page https://www.pornhub.com/signup"
[499752268] [14:39:29] Thread #9 : Thread ended with message "Failed to load page https://www.pornhub.com/signup"
[499752268] [14:39:29] Thread #1 : Thread ended with message "Failed to load page https://www.pornhub.com/signup"
[499752268] [14:39:30] Thread #10 : Thread ended with message "Failed to load page https://www.pornhub.com/signup"
[499752268] [14:39:30] Thread #7 : Thread ended with message "Failed to load page https://www.pornhub.com/signup"
[499752268] [14:39:30] Thread #9 : Thread ended with message "Failed to load page https://www.pornhub.com/signup"
[499752268] [14:39:30] Thread #1 : Thread ended with message "Failed to load page https://www.pornhub.com/signup"
[499752268] [14:39:31] Thread #10 : Thread ended with message "Failed to load page https://www.pornhub.com/signup"
[499752268] [14:39:31] Thread #7 : Thread ended with message "Failed to load page https://www.pornhub.com/signup"
[499752268] [14:39:31] Thread #9 : Thread ended with message "Failed to load page https://www.pornhub.com/signup"
[499752268] [14:39:31] Thread #1 : Thread ended with message "Failed to load page https://www.pornhub.com/signup"
[499752268] [14:39:32] Thread #10 : Thread ended with message "Failed to load page https://www.pornhub.com/signup"
[499752268] [14:39:32] Thread #7 : Thread ended with message "Failed to load page https://www.pornhub.com/signup"
[499752268] [14:39:32] Thread #9 : Thread ended with message "Failed to load page https://www.pornhub.com/signup"
[499752268] [14:39:32] Thread #1 : Thread ended with message "Failed to load page https://www.pornhub.com/signup"
[499752268] [14:39:32] Thread #10 : Thread ended with message "Failed to load page https://www.pornhub.com/signup"
[499752268] [14:39:32] Thread #9 : Thread ended with message "Failed to load page https://www.pornhub.com/signup"
[499752268] [14:39:32] Thread #7 : Thread ended with message "Failed to load page https://www.pornhub.com/signup"
[499752268] [14:39:33] Thread #1 : Thread ended with message "Failed to load page https://www.pornhub.com/signup"
[499752268] [14:39:33] Thread #10 : Thread ended with message "Failed to load page https://www.pornhub.com/signup"
-
@hackydunk change proxy type from auto to socks5 or http.
-
@hackydunk, bad proxy, need a xml
-
@seedgg I have it set to http
@root if it was a bad proxy then it wouldn't work in single threaded mode either?
-
@hackydunk Reach threads limit? All questions to your proxy service = )
-
@root I have 10 simultaneous threads service... when I use anything more than a single thread with BAS I get problems
-
@hackydunk, show part of your script.
-
section(6 /6/,500 /500/,10000 /10000/,0,function(){
section_start("\u007b\u0022n\u0022:\u0022Initialize\u0022\u007d", 0)!
_BROWSER_TYPE = 1;
section_end()!_call(_on_start, null)!
section_start("", 360571279)!
/Dat:eyJzIjoicHJveHkiLCJ2IjoxLCJmIjpbXSwidXciOiIwIiwidXQiOiIwIiwidXRvIjoiMCIsInVtIjoiMCIsImQiOlt7ImlkIjoiUHJveHlUZXh0IiwidHlwZSI6ImNvbnN0ciIsImRhdGEiOiIxMDguNTkuMTQuMjAzOjEzMDEwIiwiY2xhc3MiOiJzdHJpbmcifSx7ImlkIjoiUHJveHlUeXBlIiwidHlwZSI6ImNvbnN0ciIsImRhdGEiOiJodHRwIiwiY2xhc3MiOiJzdHJpbmcifSx7ImlkIjoiUHJveHlMb2dpbiIsInR5cGUiOiJjb25zdHIiLCJkYXRhIjoiIiwiY2xhc3MiOiJzdHJpbmcifSx7ImlkIjoiUHJveHlQYXNzd29yZCIsInR5cGUiOiJjb25zdHIiLCJkYXRhIjoiIiwiY2xhc3MiOiJzdHJpbmcifSx7ImlkIjoiVGFyZ2V0VXJsIiwidHlwZSI6ImNvbnN0ciIsImRhdGEiOiIqIiwiY2xhc3MiOiJzdHJpbmcifSx7ImlkIjoiVGFyZ2V0VGFiTnVtYmVyIiwidHlwZSI6ImNvbnN0ciIsImRhdGEiOiIqIiwiY2xhc3MiOiJzdHJpbmcifV19/
/Browser/
var hash = proxy_parse("ROTATING PROXY IP:PORT")
if("http" != "auto" ){
hash["IsHttp"] = "http" == "http"
}
var login = ""
var password = ""
if(login.length > 0 && password.length > 0 )
{
hash["name"] = login
hash["password"] = password
}
set_proxy(hash["server"], hash["Port"], hash["IsHttp"], hash["name"], hash["password"])!
section_end()!section_start("", 499752268)!
/Dat:eyJzIjoibG9hZCIsInYiOjEsImYiOltdLCJ1dyI6IjEiLCJ1dCI6IjAiLCJ1dG8iOiIwIiwidW0iOiIwIiwiZCI6W3siaWQiOiJMb2FkVXJsIiwidHlwZSI6ImNvbnN0ciIsImRhdGEiOiJodHRwczovL3d3dy5wb3JuaHViLmNvbS9zaWdudXAiLCJjbGFzcyI6InN0cmluZyJ9XX0=/
/Browser/
load("https://www.pornhub.com/signup")!
section_end()!Proxy IP:PORT removed for obvious reasons
-
@hackydunk Problem i think in your proxies. I have checked proxies to resource (https://www.pornhub.com/signup) before using. There are some public socks5. Try it. socks5
-
When I run the script with a single thread I get almost zero failures over several hundred runs... Do you think my proxies are not working during multithreading?
I submitted a support ticket to my proxy provider with some details. Will see what they say
@seedgg I ran my script multi-threaded with the public proxies you provide me...socks5 and saw a ~66% success/failure ratio
-
@hackydunk yes, it's just a public not stable proxies. It's for test.
-
I'm going to mark this thread as [SOLVED].
I believe my proxy package is not large enough to support multi-threading.
See response from my proxy provider below...
"10 Threads Package is designed just for testing in SEO tools!
Regular browsers use more than 10 threads and you will get many errors if you use 10 threads package in browser.
You can check that in this article:
http://www.stevesouders.com/blog/2008/03/20/roundup-on-parallel-connections/Please test proxies inside some SEO tool by actually using tool.
If you visit one webpage it has many elements (css, javascript, external images, etc.) that are parsed with parallel requests (threads) from browser.
So, for one single tab and one single page browser use a lot of threads - not just one.That is why smallest "test" package of 10 threads is not enough for regular surfing in browser or any bot that use browser."
Thanks everyone!!!
