I can suggest you a few simple tweaks as a start (for DOSBOX 0.74-2):
fullscreen=false (either true or false it's your choice)
fulldouble=false (better leave it like that)
fullresolution=1440x900 (change that to your screen resolution)
windowresolution=640x480 (for SVGA this is the best I think)
output=opengl (ddraw is not supported on the latest Windows)
***
memsize=32 (64 is overkill, that's the limit of DOSBOX use it only if you need it)
aspect=false (you don't need it enabled if you use opengl or ddraw for output)
scaler=hq3x (super2xsai is good too but I prefer hq3x)
***
core=dynamic (if you have more than one CPU core)
***
rate=49716 (for every sound config use 49716 for best quality I prefer to use only Sound Blaster 16)
***
prebuffer=20 (higher values may lead to not very pleasant results)
***
oplemu=compat (because it's the best option)
***
Tip: You can disable gus and pcspeaker if you are not using them.
***
timed=false (if you use a joystick, like me, this will save you a few headaches)
***
For the [autoexec] section I use this commands (available for every DOS game not specific to ICR2):
@ECHO OFF
MOUNT C D:\DOS
C:
CLS
I hope that this will serve you as a basic guide. If you have any questions - just ask.