Problem with bot development (Cookies)

[Utharnl]

Hey all, got a question for the other bot developers here.
Was trying to make a small bot for Grepolis (Building queue only).

I created my other bots with C#, using httpget and httppost requests. That way I can easily get the cookies from the response header (Set-Cookie).

But now comes the problem...
The developers of Grepolis found a way to set cookies without Set-Cookie. Looks like they use java script for it.

The cookie called PHPSESSID is still set using Set-Cookie but portal_tid is not.
To login on the server I need both cookies

Someone that can help me with it?
Or if you want to try it yourself to make a bot that can login on this game:




Greetings Uthar

[jere88]

Hey,

I think you are in the wrong section.
Maybe you can ask in the Coding Section for help

[Atheuz]

Originally Posted by Utharnl

Hey all, got a question for the other bot developers here.
Was trying to make a small bot for Grepolis (Building queue only).

I created my other bots with C#, using httpget and httppost requests. That way I can easily get the cookies from the response header (Set-Cookie).

But now comes the problem...
The developers of Grepolis found a way to set cookies without Set-Cookie. Looks like they use java script for it.

The cookie called PHPSESSID is still set using Set-Cookie but portal_tid is not.
To login on the server I need both cookies

Someone that can help me with it?
Or if you want to try it yourself to make a bot that can login on this game:




Greetings Uthar

Login1

PHP Code:

http://de.grepolis.com/start/?action=ajax_played_worlds&name=derp&password=hurp 


This will retrieve the set of worlds the account has access to.

Login2

PHP Code:

http://de.grepolis.com/start?action=login
- world=4&facebook_login=&name=derp&password=hurp 


This actually logs a player in, including the session_id in the response.

PHP Code:

http://de4.grepolis.com/game/login?session_id=1fl802syva2s 


Simply use the session id from now on you got from the response.


In my testing I was able to retrieve the session id perfectly and without to use any other part of the cookie for the rest of the requests. You have to crawl the response html though for valueable information.

[Utharnl]

Thanks Atheuz, but how did you test it?
Because I'm having problems with the second login (Probably because I'm missing a cookie?)

PHP Code:

http://nl.grepolis.com/start?action=login
- world=1&facebook_login=&name=Uthar&password=Utharpw 


The response I get from the second login is:
The remote server returned an error: (417) Expectation Failed.

-edit-
Previous error fixed by adding

System.Net.ServicePointManager.Expect100Continue = false;

Trying to get session_id now, will keep you updated

~Uthar

[Die Schnittstelle]

#moved

[Utharnl]

Thanks for moving it to the correct section Mio.

I can't get it to work with my current htmlhandler.
The location header:

Location: http://nl1.grepolis.com/game/login?session_id=d64ma2eqtts0

Is causing an auto redirect and my code can't get that response.

I'm using the class "System.Net.WebRequest" for my requests. Does anybody know if I can turn of the auto redirection?

After some research I found that the class HttpWebRequest has the option to turn auto redirection of. If it isn't possible to turn it of with "System.Net.WebRequest" I could always rewrite my code and use HttpWebRequest.


-edit-
Looks like I can just cast it to an HttpWebRequest

HttpWebRequest l_Req = (HttpWebRequest)WebRequest.Create(p_URI);
l_Req.AllowAutoRedirect = false;

Going to try again now to see if it works, will let you know when I'm stuck again.




//edit :


I'm almost done with the login process, stuck at the last step now.

Successfully called "http://nl1.grepolis.com/game/login?session_id=4r5anyvv32m8" and retrieved some cookies.

The final step of the login process is to visit "http://nl1.grepolis.com/game/index" but I get only a empty page as response with a Location header that contains:
"http://nl.grepolis.com/start?nosession"

I can simulate a location header with "http://nl.grepolis.com/start?nosession" in a normal browser by logging in with cookies turned off.

Does someone want to give it a try to write some code to login on this game?
I have no idea what goes wrong, any help/tips are welcome!

Greetings Uthar

[Cholik]

Okay just wrote some stuff...



Hope I could help you.

[Utharnl]

Thanks Walter,
Used WireShark to check the http request your code send, was almost the same as my code.
Changed my code a bit so that the requests were the same, but still not working.

It looks like the Location header is causing the problem.
Because your class saves cookies automatic you can follow the Location header without any problems.
In my case I have to visit each location in the Location header manually because my cookies are lost otherwise.

Somewhere there is a small difference in how I do it manually and how your class does it automatic. No idea what ^^

But I must say it looks a lot easier to use the class WebClient like you.
I think I will give that a try tomorrow.


//edit
Thanks for the help, I have it working now.
Here is the link to the bot:


~Uthar