EDIT: This issue has been solved, see two posts down if you wish to skip straight to the solution.
I have begun test burning to find if it is possible to get a BDMV title working from BD-RE media on a Playstation 3. Since this doesn't appear to be as straightforward as burning the layout folders to disc, some experimentation is needed.
I believe that using a PC burner, rewritable discs and a Playstation 3 player has the potential to be the most cost effective option for testing of home authoring, beyond using a software player such as PowerDVD, and that other aspiring developers will be going through the same problems. Online opinions are mixed with a few posts claiming to have achieved it (but documenting their findings pretty shabbily), while other sources say it's impossible and locked down by Sony. I will be attempting to burn a known working image to BD-RE (rewritable) disc, and will document my findings as successive edits of this post.
Here is some information about my test setup:
Content: The sample project from the book 'HD Cookbook', which I have written about in this post:
http://chrishatton.homeip.net/bdjforum/viewtopic.php?f=2&t=7
As a starting point, this project plays perfectly in PowerDVD 7.3, including front menu, video, subtitles, popup menus and the BD-J test game.
Burner: LG GGW-H20L 'Super Multi Blue' upgraded to latest firmware, YL02.
Player: Playstation 3, 40Gb UK Model. Firmware v2.10
Test1: Burned project layout files to Verbatim BD-RE using Nero 7.?? selecting UDF 2.50.
Result: Playstation recognised BDMV disc. When played the PS3 entered Blu-ray playing mode but halted on a blank screen with no messages.
Test2: Burned project layout files to TDK BD-RE using ImgBurn selecting UDF 2.50. This was my first use of the media and ImgBurn erased the entire disc first.
Result: Again, PS3 recognised it as a BDMV disc. When played the PS3 entered Blu-ray playing mode but halted on a blank screen with no messages.
Interestingly, when I first tried to play this burned disc on the PC under PowerDVD, it acted in the same way as the Playstation. The second time it played okay. Not sure if this is encouraging or not, but it does play fine every time from the hard disc, so maybe?
Test3: I acquired a test image from a Sonic Scenarist BDA project (this is a serious product and should provide a fully compliant image). I burned it using ImgBurn to TDK BD-RE.
Result: Playstation gave the error message "This is an Invalid disc (80029906)".
At this point I burned a BDAV disc using PowerProducer 7 and a couple of random video files, just to test that the PS3 could read data from the BD-RE under very controlled circumstances with something that 'should definitely work'. For those that don't know, BDAV is a level of writing a Blu-ray disc, below BDMV, which doesn't include any menus, just video and chapter points. Amongst other applications this is intended as a format for HD consumer cameras to record in. The PS3 played the videos, confirming that physical disc burning and reading is working properly.
