Yahoo Groups archive

Disklavier

Index last updated: 2026-04-28 23:20 UTC

Message

Re: [disklavier] Re: Editing file from Disklavier Pro Mark IV

2014-09-03 by Spencer Chase

so far there does not even seem to be one person expressing interest in an editing tool so this is probably not worth pursuing but...
i can think of several ways to approach the problem that could work but not worth even testing if there will not be at least a minimal market for an editor.

the most promising thing i can think of that i could write (not interested in writing a full graphical sequencer unless i knew i could sell hundreds of copies at a high price ) would be a program that would convert an XP midi file to\ufffd tabbed text so it could be edited in excel and then converted back. this would still be good only for simple edits.

i would start by looking at GNMidi and see if it does midi to text and back and if the text created looks like it could be useful. too busy to look myself. Gunter is a great programmer and if GNMidi does anything close to what is needed, he would probably be open to making it more useful.

On 9/3/2014 9:31 AM, PianoBench@... [disklavier] wrote:
\ufffd

Mark, Spencer, and Carol,


A few concluding points:

Yes, there was an XGWorks sequencer from Yamaha many years ago. I do not believe that it had any awareness of XP data.

The XP data format is complicated. The short story is that certain controllers are used to associate extra data with each note-on and note-off message. Controllers, however, are not note-specific, and therefore Yamaha uses polyphonic aftertouch messages in order to alert the system to the fact that the controllers which immediately follow the polyphonic aftertouch message on the same clock tick belong to that particular note.

If you want to have all of the fancy editing of a modern sequencer and apply those features to an XP file, you really should have an XP-aware sequencer that hides the extra data from view and makes appropriate adjustments to it when you change the start-time, the velocity, or the pitch of a note-on or note-off message. And, the XP-aware sequencer must maintain the order of events.

The idea of pre-procesing the XP MIDI file to offset the extra data so that a sequencer will not change the order of the XP events is an intriguing idea. However, if you use the sequencer to edit the starting point of note-on or note-off messages, things will start to unravel.

Regards,\ufffd
PianoBench


On Sep 2, 2014, at 10:11 PM, Mark Fontana mark@... [disklavier] <disklavier@yahoogroups.com> wrote:



To avoid distorting the timing, you'd leave each note-on at its original tick offset in the file and adjust the delta times of the note-on and preceding XP events to indicate an order by spacing them a tick apart, such that no elapsed time is added or lost.\ufffd This would involve moving the XP events slightly earlier in time, so your processing would require a global view of the events.

I'm assuming that a key problem when editing XP files is that the editing software thinks it's OK to rearrange the order of events occurring at the same tick.


On 09/02/2014 12:11 PM, Spencer Chase\ufffdlists@...\ufffd[disklavier] wrote:
\ufffd

to be clear, do you think it might work to process all events in order and to add one tick (cumulatively) to each event that follows the first at the same time. does the note on occur first followed by some number of other events with delta time 0? if i change the first delta time event following the note on to a delta time of 1, and any subsequent ones also to one, this would make a series of events all one tick after the previous. should not be difficult to do. is it worth trying? have you tried this? anyone else offer it as a utility?

On 9/2/2014 9:42 AM, Mark Fontana\ufffdmark@...\ufffd[disklavier] wrote:
\ufffd


To facilitate the use of non-XP-aware editors, it seems like it might be possible to pre-process the XP MIDI file PRIOR to editing, to offset the events by a tick when order needs to be maintained, preserving the original timing of the note-ons whenever possible.\ufffd\ufffd One would still need to be cautious when editing to remove all associated events when deleting an XP note and inserting all needed events in the proper order when adding one.

It seems like this would allow most MIDI editors to export an XP MIDI file that would be ready to play without any further processing.


On 09/02/2014 11:26 AM, Spencer Chase\ufffdlists@...\ufffd[disklavier] wrote:
\ufffd

you suggest that it is possible to edit a high res dkv file with a conventional sequencer and that the only problem is that the extra events that encode the high res data can be put out of order in the file. a few things of interest:

i am not sure how the conventional sequencer would handle these extra events other than just deleting them if you deleted a note message. i don't see how you could fine tune these events or add them to added or modified notes. maybe this would be rarely necessary and all that is needed is the ability to remvoe them along with the note event and maybe the sequencer would do this.

i know that Cakewalk, for example. does convert to its own format which is pretty much essential as it is impossible (not really, a high speed computer could do it today but still better to convert to realtime) to make much in the way of changes in delta time format. it does make sense that the event order could change. so, if all that is necessary is to put the events in the right order, maybe that would be possible with a post processor. If all events at the same time in a cluster need to be put in a specific order based on type, i could write a program to do that. I process MIDI data in realtime (tick total from start of file) and write the data back in the order I choose so I could do this. Does this sound useful?

On 9/2/2014 5:31 AM,\ufffdPianoBench@...\ufffd[disklavier] wrote:
\ufffd

Good morning, Bob.


When I wrote my previous reply, I was curious as to how you were listening to the piece following your edits. Possibilities would have includee:

--playback from internal memory of the Mark IV PRO or from a USB flash drive

--playback on the Mark IV PRO, receiving data from the computer, in which case the Disklavier is set to receive MIDI data in either real time or with a 500ms delay added

--playback using the tone generator of your computer or a soft synth running on your computer

--playback using another MIDI device

Unless you are playing back on the Mark IV PRO from its internal memory or from a USB flash drive, your perception of the quality of the playback may have been affected by any of several factors. I'll assume playback from internal memory or from USB flash drive.

All Disklaviers record performances as MIDI data. The PRO, however, uses normally unused MIDI controllers along with polyphonic aftertouch messages to store extra bits of resolution. This means that note-on and note-off messages are effectively recorded on a scale of 0-1023 instead of the usual MIDI scale of 0-127 and the left and right pedals are recorded on a scale of 0-255 instead of 0-127. In addition to recording hammer velocity (as note-on messages), the PRO also records key down velocity.

In theory, you should be able to edit a PRO recording in a MIDI sequencer and not lose any of the granularity of the recorded data. However, typical MIDI sequencers are not pure MIDI editors: most of them import MIDI data into their own format and then export to MIDI when you are done. During the import and/or export process, they typically mess with the order of the extra MIDI events that you find in a PRO file. These extra MIDI events, which occur on the same clock tick, must be in a particular order so that the Disklavier can interpret them correctly.

It is entirely possibly that when you edited and saved your file, you effectively lost the granularity of the data. However, the overall range of expression (from the softest to the loudest notes) should be unchanged. Your PRO has an amazing set of solenoids and an advanced servo mechanism, which means that it should do a really great job playing data with normal MIDI resolution.

Regrettably, there are no good choices for a program that can edit the MIDI data in a PRO recording.

For more information about how the PRO works, you might want to check out the video that I made and posted on the home page of the Disklavier Education Network:


Regards,
PianoBench

On Sep 2, 2014, at 6:52 AM, Robert Hall\ufffdeviscent@...\ufffd[disklavier] <disklavier@yahoogroups.com> wrote:

After I edited there seemed to be less discrepancy, the performance seemed more crude. I had read the promo about the Pro technology which is summarized here: (lifted from Wikipedia)


In 1999, "Disklavier Pro" was introduced to the American market, the "II Pro". A key selling feature of this version was a claim of greater playback accuracy than had been possible with previously available models.[3]\ufffd\ufffdThe Pro made use of a proprietary enhancement of MIDI data, which subdivided the timing information in an effort to allow greater precision. Rather than using the standard 127 levels of midi velocity, Yamaha introduced 1023 levels for KeyAfterTouch, NoteOn and NoteOff. A similar principle was applied to the pedal performance data, using 256 increments of measurement in an effort to allow finer capture and reproduction of, for example, half and quarter pedaling by the player. These developments allowed Yamaha to claim a greater overall accuracy in the reproduction of an original piano performance.[3]
I assumed that perhaps in editing in the Midi format I had lost something.\ufffd

Bob



-- 

Best regards, Spencer Chase
67550-Bell Springs Rd.
Garberville, CA 95542 Postal service only.
Laytonville, CA 95454 UPS only.
Spencer@...
http://www.spencerserolls.com
(425) 791-0309


-- 

Best regards, Spencer Chase
67550-Bell Springs Rd.
Garberville, CA 95542 Postal service only.
Laytonville, CA 95454 UPS only.
Spencer@...
http://www.spencerserolls.com
(425) 791-0309




-- 

Best regards, Spencer Chase
67550-Bell Springs Rd.
Garberville, CA 95542 Postal service only.
Laytonville, CA 95454 UPS only.
Spencer@...
http://www.spencerserolls.com
(425) 791-0309

Attachments

Move to quarantaine

This moves the raw source file on disk only. The archive index is not changed automatically, so you still need to run a manual refresh afterward.