I've somewhat familiarized myself with DOS, but Scumm is new to me completely. I'm trying to play Beneath a Steel Sky and I can do fullscreen and the windowed version, but I was wondering if there was a way I could scale it like I do dosbox, make the windowed version bigger. Thanks.

ScummVM has [url=http://wiki.scummvm.org/index.php/User_Manual/Appendix:_Graphic_filters]graphics filters[/url] that work like the scaling options in DOSBox.

Ok cool. The .ini appears differently to me when I bring it up, what is It i should be looking for in the note pad in order to change the settings?

No need to mess with the ini file. Go into the shortcut properties:
Change:
"C:\GOG Games\Beneath a Steel Sky\ScummVM\scummvm.exe" -c "C:\GOG Games\Beneath a Steel Sky\beneath.ini" beneath
To:
"C:\GOG Games\Beneath a Steel Sky\ScummVM\scummvm.exe" -c "C:\GOG Games\Beneath a Steel Sky\beneath.ini" -g3x beneath
That -g3x will scale the graphics to 960x720