What you did is right, but have forgot to write your changes. You need to open an Outputstream to write those changes.
FileOutputStream outputStream = new FileOutputStream("yourfile");
workbook.write(outputStream);
workbook.close();
outputStream.close();
Hope this works!!
CLICK HERE to find out more related problems solutions.