📚 OpenRCE is preserved as a read-only archive. Launched at RECon Montreal in 2005. Registration and posting are disabled.








Flag: Tornado! Hurricane!

 Forums >>  Debuggers  >>  Debugging Fullscreen Mode Application

Topic created on: July 9, 2006 23:57 CDT by ryanc .

I'm a beginner reverser so this might be elementary, but I'm trying to bp out of a fullscreen graphics mode app, but when I do my desktop is completely black and orange... I can't get control of or even see olly without closing the game. Any ideas on how this should be done?

  quasar     July 10, 2006 03:56.32 CDT
Probably it's not a problem of crashing Olly but game uses DirectX. Get good gfx card and use second monitor for debugging.

  ZaiRoN     July 10, 2006 05:04.50 CDT
Try running the application in windowed mode, you should solve the problem.

  2GooD     October 15, 2006 07:56.33 CDT
The german demo version of the adventure game "Undercover: Operation Wintersun" (In German: "UNDERCOVER: Operation Wintersonne") gives me this error message when I start it, right after going to fullscreen:

Unable to initialize video mode:
Pixel format could not be set.

After that, the game exists.

As an exercise I thought I would try to workaround this error. For a start I ran the demo in OllyDbg but I get the same issue as Ryan.

I've found two different tools, both called "DxWnd", that are supposed to aid in this, and one of them managed to do it, but still keeps the window on top of OllyDbg.

Maybe I should try to intercept the change to fullscreen mode in OllyDbg?

Update: As the error went away when I upgraded my graphics card drivers, I won't persue this... :-)

  scavenger     July 9, 2008 15:14.17 CDT
perhaps you could debug in kernel mode remotely?

  Soul12     July 10, 2008 01:25.40 CDT
you can also , if you can live with big fronts :) set ollydbg to be "always on top" so when it breaks..it will show infront of the 3d rendered stuff..but has limited use ofcourse..since the window size will prolly be a little off

Note: Registration is required to post to the forums.

There are 31,328 total registered users.


Recently Created Topics
[help] Unpacking VMP...
Mar/12
Reverse Engineering ...
Jul/06
let 'IDAPython' impo...
Sep/24
set 'IDAPython' as t...
Sep/24
GuessType return une...
Sep/20
About retrieving the...
Sep/07
How to find specific...
Aug/15
How to get data depe...
Jul/07
Identify RVA data in...
May/06
Question about memor...
Dec/12


Recent Forum Posts
Finding the procedur...
rolEYder
Question about debbu...
rolEYder
Identify RVA data in...
sohlow
let 'IDAPython' impo...
sohlow
How to find specific...
hackgreti
Problem with ollydbg
sh3dow
How can I write olly...
sh3dow
New LoadMAP plugin v...
mefisto...
Intel pin in loaded ...
djnemo
OOP_RE tool available?
Bl4ckm4n


Recent Blog Entries
halsten
Mar/14
Breaking IonCUBE VM

oleavr
Oct/24
Anatomy of a code tracer

hasherezade
Sep/24
IAT Patcher - new tool for ...

oleavr
Aug/27
CryptoShark: code tracer ba...

oleavr
Jun/25
Build a debugger in 5 minutes

More ...


Recent Blog Comments
nieo on:
Mar/22
IAT Patcher - new tool for ...

djnemo on:
Nov/17
Kernel debugger vs user mod...

acel on:
Nov/14
Kernel debugger vs user mod...

pedram on:
Dec/21
frida.github.io: scriptable...

capadleman on:
Jun/19
Using NtCreateThreadEx for ...

More ...


Imagery
SoySauce Blueprint
Jun 6, 2008

[+] expand

View Gallery (11) / Submit