LawalMcCoy - Revision history

imported>Psych2012: /* Introduction */

2012-03-22T04:58:15Z

Introduction

← Older revision		Revision as of 04:58, 22 March 2012
Line 3:		Line 3:
	== Introduction ==		== Introduction ==

	Subtitles are used as common tools to help audiences understand dialogue that they otherwise would be unable to interpret. However, by simply overlaying white text above the image there is a chance that the subtitles themselves will be unreadable. The main goal of our project was to develop a program in MATLAB that achieves visually pleasing viewing properties for a given subtitle and frame (picture) combination. Although the best solution is to have real people go through a movie, frame by frame, and decide what viewing properties for the subtitles makes them most visible, developing an automated solution may be the next best thing. Many films, particularly foreign films, may not have the budget to ~~have~~ personally add subtitles to their movies and would greatly benefit from such an algorithm.		Subtitles are used as common tools to help audiences understand dialogue that they otherwise would be unable to interpret. However, by simply overlaying white text above the image there is a chance that the subtitles themselves will be unreadable. The main goal of our project was to develop a program in MATLAB that achieves visually pleasing viewing properties for a given subtitle and frame (picture) combination. Although the best solution is to have real people go through a movie, frame by frame, and decide what viewing properties for the subtitles makes them most visible, developing an automated solution may be the next best thing. Many films, particularly foreign films, may not have the budget to personally add subtitles to their movies and would greatly benefit from such an algorithm.

	When deciding how to create the optimal subtitles, we investigated a number of variables, including the location of the subtitles, the color of the subtitles, and any potential shadowing around the subtitles. When comparing colors, our program uses the CIELAB metric of DeltaE as a proxy for perceptual differences between the surrounding image and the subtitles. Color theory states that the larger the DeltaE between two objects, the more discernible they are to the human eye. In this situation we analyzed the average DeltaE difference between text and other pixels in the textbox.		When deciding how to create the optimal subtitles, we investigated a number of variables, including the location of the subtitles, the color of the subtitles, and any potential shadowing around the subtitles. When comparing colors, our program uses the CIELAB metric of DeltaE as a proxy for perceptual differences between the surrounding image and the subtitles. Color theory states that the larger the DeltaE between two objects, the more discernible they are to the human eye. In this situation we analyzed the average DeltaE difference between text and other pixels in the textbox.

imported>Psych2012: /* Introduction */

2012-03-22T04:57:42Z

Introduction

← Older revision		Revision as of 04:57, 22 March 2012
Line 3:		Line 3:
	== Introduction ==		== Introduction ==

	Subtitles are used as common tools to help audiences understand dialogue that they otherwise would be unable to interpret. However, by simply overlaying white text above the image there is a chance that the subtitles themselves will be unreadable. The main goal of our project was to develop a program in MATLAB that achieves visually pleasing viewing properties of a given subtitle and frame (picture) combination. Although the best solution is to have real people go through a movie, frame by frame, and decide what viewing properties for the subtitles makes them most visible, developing an automated solution may be the next best thing. Many films, particularly foreign films, may not have the budget to have personally add subtitles to their movies and would greatly benefit from such an algorithm.		Subtitles are used as common tools to help audiences understand dialogue that they otherwise would be unable to interpret. However, by simply overlaying white text above the image there is a chance that the subtitles themselves will be unreadable. The main goal of our project was to develop a program in MATLAB that achieves visually pleasing viewing properties for a given subtitle and frame (picture) combination. Although the best solution is to have real people go through a movie, frame by frame, and decide what viewing properties for the subtitles makes them most visible, developing an automated solution may be the next best thing. Many films, particularly foreign films, may not have the budget to have personally add subtitles to their movies and would greatly benefit from such an algorithm.

	When deciding how to create the optimal subtitles, we investigated a number of variables, including the location of the subtitles, the color of the subtitles, and any potential shadowing around the subtitles. When comparing colors, our program uses the CIELAB metric of DeltaE as a proxy for perceptual differences between the surrounding image and the subtitles. Color theory states that the larger the DeltaE between two objects, the more discernible they are to the human eye. In this situation we analyzed the average DeltaE difference between text and other pixels in the textbox.		When deciding how to create the optimal subtitles, we investigated a number of variables, including the location of the subtitles, the color of the subtitles, and any potential shadowing around the subtitles. When comparing colors, our program uses the CIELAB metric of DeltaE as a proxy for perceptual differences between the surrounding image and the subtitles. Color theory states that the larger the DeltaE between two objects, the more discernible they are to the human eye. In this situation we analyzed the average DeltaE difference between text and other pixels in the textbox.

imported>Psych2012: /* Survey */

2012-03-22T04:12:32Z

Survey

← Older revision		Revision as of 04:12, 22 March 2012
Line 113:		Line 113:
	In the second part of the survey we showed three different frames from a movie. In one of the frames there was a white color subtitle with a shadow (which was not optimal), an optimal shade of gray subtitle with a shadow, and lastly an optimal shade of gray subtitle without a shadow.		In the second part of the survey we showed three different frames from a movie. In one of the frames there was a white color subtitle with a shadow (which was not optimal), an optimal shade of gray subtitle with a shadow, and lastly an optimal shade of gray subtitle without a shadow.

	For the first part of the survey our results indicated that the average rating was 3.85, with a standard deviation of 0.75. There were no statistically significant difference between the five videos used in the polling, this ~~inclues~~ the black and white video. For the second part of the survey we found that consistently people considered the DeltaE differential maximized subtitle with a shadow as the least visually appealing. Generally, people found the DeltaE maximized shade of gray without the subtitle to be the best and the white subtitle with the shadow to be middle best. While there was a distinctive ranking between the three images, subjective feedback later on led us to believe the gap between the DeltaE maximized shade of gray without the subtitle and that of the white subtitle with the shadow was not extreme. This yields us to believe that the effect of the shadow works best with white subtitles, and perhaps can compensate for lack of DeltaE differential.		For the first part of the survey our results indicated that the average rating was 3.85, with a standard deviation of 0.75. There were no statistically significant difference between the five videos used in the polling, this includes the black and white video. For the second part of the survey we found that consistently people considered the DeltaE differential maximized subtitle with a shadow as the least visually appealing. Generally, people found the DeltaE maximized shade of gray without the subtitle to be the best and the white subtitle with the shadow to be middle best. While there was a distinctive ranking between the three images, subjective feedback later on led us to believe the gap between the DeltaE maximized shade of gray without the subtitle and that of the white subtitle with the shadow was not extreme. This yields us to believe that the effect of the shadow works best with white subtitles, and perhaps can compensate for lack of DeltaE differential.

	===More Images===		===More Images===

imported>Psych2012: /* Subjective Survey of Optimizing Colors */

2012-03-22T04:11:37Z

Subjective Survey of Optimizing Colors

← Older revision		Revision as of 04:11, 22 March 2012
Line 94:		Line 94:

	[http://www.stanford.edu/~mccoylm/DoYouUnder.mp4 Rush Hour (2)]		[http://www.stanford.edu/~mccoylm/DoYouUnder.mp4 Rush Hour (2)]

	~~=== Subjective Survey of Optimizing Colors ===~~

	== Challenges==		== Challenges==

imported>Psych2012: /* Appendix II - Work Partition */

2012-03-22T04:10:06Z

Appendix II - Work Partition

← Older revision		Revision as of 04:10, 22 March 2012
Line 181:		Line 181:
	Logan - Developed most of algorithm, helped with slides and wiki		Logan - Developed most of algorithm, helped with slides and wiki

	Tola - Helped with algorithm by making helper functions, found movie clips and frames online, made presentation slides~~, administered survey~~		Tola - Helped with algorithm by making helper functions, found movie clips and frames online, made presentation slides

	Together - Decided on the basic algorithm, ran the scripts to create movie clips with captions.		Together - Decided on the basic algorithm, ran the scripts to create movie clips with captions.

imported>Psych2012: /* Appendix II - Work Partition */

2012-03-22T04:09:57Z

Appendix II - Work Partition

← Older revision		Revision as of 04:09, 22 March 2012
Line 181:		Line 181:
	Logan - Developed most of algorithm, helped with slides and wiki		Logan - Developed most of algorithm, helped with slides and wiki

	Tola - Helped with algorithm by making helper functions, found movie clips and frames online, made presentation slides		Tola - Helped with algorithm by making helper functions, found movie clips and frames online, made presentation slides, administered survey

	Together - Decided on the basic algorithm, ran the scripts to create movie clips with captions.		Together - Decided on the basic algorithm, ran the scripts to create movie clips with captions.

imported>Psych2012: /* Survey */

2012-03-22T04:09:03Z

Survey

← Older revision		Revision as of 04:09, 22 March 2012
Line 109:		Line 109:
	===Survey===		===Survey===

	~~Upon~~ polling ~~residents in our dorm~~, we found that consistently people ~~found~~ the DeltaE differential maximized subtitle with a shadow as the least visually appealing. Generally, people found the DeltaE maximized shade of gray without the subtitle to be the best and the white subtitle with the shadow to be middle best. While there was a distinctive ranking between the three images, subjective feedback later on led us to believe the gap between the DeltaE maximized shade of gray without the subtitle and that of the white subtitle with the shadow was not extreme. This yields us to believe that the effect of the shadow works best with white subtitles, and perhaps can compensate for lack of DeltaE differential. In addition, we asked participants to rate on an absolute scale of 1-5 (5 as being the best) how visible the white subtitles with the shadow were. The average rating was 3.85, with a standard deviation of 0.75. There were no statistically significant difference between the five videos used in the polling, this inclues the black and white video.		We performed a survey that was divided into two parts.

			In the first part of the survey we showed people five different video clips with bright white subtitles. The participants were asked to rate on an absolute scale of 1-5 (5 as being the best) how visible the white subtitles with the shadow were.

			In the second part of the survey we showed three different frames from a movie. In one of the frames there was a white color subtitle with a shadow (which was not optimal), an optimal shade of gray subtitle with a shadow, and lastly an optimal shade of gray subtitle without a shadow.

			For the first part of the survey our results indicated that the average rating was 3.85, with a standard deviation of 0.75. There were no statistically significant difference between the five videos used in the polling, this inclues the black and white video. For the second part of the survey we found that consistently people considered the DeltaE differential maximized subtitle with a shadow as the least visually appealing. Generally, people found the DeltaE maximized shade of gray without the subtitle to be the best and the white subtitle with the shadow to be middle best. While there was a distinctive ranking between the three images, subjective feedback later on led us to believe the gap between the DeltaE maximized shade of gray without the subtitle and that of the white subtitle with the shadow was not extreme. This yields us to believe that the effect of the shadow works best with white subtitles, and perhaps can compensate for lack of DeltaE differential.

	===More Images===		===More Images===

imported>Psych2012: /* Survey */

2012-03-22T04:01:05Z

Survey

← Older revision		Revision as of 04:01, 22 March 2012
Line 109:		Line 109:
	===Survey===		===Survey===

	Upon polling residents in our dorm, we found that consistently people found the DeltaE differential maximized subtitle with a shadow as the least visually appealing. Generally, people found the DeltaE maximized shade of gray without the subtitle to be the best and the white subtitle with the shadow to be middle best. While there was a distinctive ranking between the three images, subjective feedback later on led us to believe the gap between the DeltaE maximized shade of gray without the subtitle and that of the white subtitle with the shadow was not extreme. This yields us to believe that the effect of the shadow works best with white subtitles, and perhaps can compensate for lack of DeltaE differential. In addition, we asked participants to rate on a scale of 1-5 (5 as being the best) how visible the white subtitles with the shadow were. The average rating was 3.85, with a standard deviation of 0.75. There were no statistically significant difference between the five videos used in the polling, this inclues the black and white video.		Upon polling residents in our dorm, we found that consistently people found the DeltaE differential maximized subtitle with a shadow as the least visually appealing. Generally, people found the DeltaE maximized shade of gray without the subtitle to be the best and the white subtitle with the shadow to be middle best. While there was a distinctive ranking between the three images, subjective feedback later on led us to believe the gap between the DeltaE maximized shade of gray without the subtitle and that of the white subtitle with the shadow was not extreme. This yields us to believe that the effect of the shadow works best with white subtitles, and perhaps can compensate for lack of DeltaE differential. In addition, we asked participants to rate on an absolute scale of 1-5 (5 as being the best) how visible the white subtitles with the shadow were. The average rating was 3.85, with a standard deviation of 0.75. There were no statistically significant difference between the five videos used in the polling, this inclues the black and white video.

	===More Images===		===More Images===

imported>Psych2012: /* Conclusions */

2012-03-22T04:00:10Z

Conclusions

← Older revision		Revision as of 04:00, 22 March 2012
Line 145:		Line 145:
	Both optimizing the color of subtitles and creating a shadowing-effect around the subtitles can be very effective ways to increase the readability of subtitles. These methods however seem to be more effective when used without the other method. Both the white subtitles with the shadowing and the optimized gray subtitles without the shadowing ranked higher among our survey results than the optimized gray subtitles with the shadowing. This may be because our shadowing algorithm was developed for white subtitles and would need to be further adjusted to be effective on non-white subtitles.		Both optimizing the color of subtitles and creating a shadowing-effect around the subtitles can be very effective ways to increase the readability of subtitles. These methods however seem to be more effective when used without the other method. Both the white subtitles with the shadowing and the optimized gray subtitles without the shadowing ranked higher among our survey results than the optimized gray subtitles with the shadowing. This may be because our shadowing algorithm was developed for white subtitles and would need to be further adjusted to be effective on non-white subtitles.

	This helps to answer our original question of whether DeltaE represents a valuable metric for how discernible subtitle text is to the viewer. It clearly helps to have higher DeltaE values, however, subjective factors such as font, font size, font weight, shadowing, etc. are also as important and cannot be ignored.		This helps to answer our original question of whether DeltaE represents a valuable metric for how discernible subtitle text is to the viewer. It clearly helps to have higher DeltaE values, however, subjective factors such as font, font size, font weight, shadowing, etc. are also as important and cannot be ignored. Increased discriminability translates to increased clarity in subtitles.

	=== Potential Extensions ===		=== Potential Extensions ===

imported>Psych2012: /* Survey */

2012-03-22T03:57:43Z

Survey

← Older revision		Revision as of 03:57, 22 March 2012
Line 109:		Line 109:
	===Survey===		===Survey===

	Upon polling residents in our dorm, we found that consistently people found the DeltaE differential maximized subtitle with a shadow as the least visually appealing. Generally, people found the DeltaE maximized shade of gray without the subtitle to be the best and the white subtitle with the shadow to be middle best. ~~However,~~ there was ~~not~~ a ~~massive preference~~ between the ~~latter two~~. This yields us to believe that the effect of the shadow works best with white subtitles, and perhaps can compensate for lack of DeltaE differential. In addition, we asked participants to rate on a scale of 1-5 (5 as being the best) how visible the white subtitles with the shadow were. The average rating was 3.85, with a standard deviation of 0.75. There were no statistically significant difference between the five videos used in the polling, this inclues the black and white video.		Upon polling residents in our dorm, we found that consistently people found the DeltaE differential maximized subtitle with a shadow as the least visually appealing. Generally, people found the DeltaE maximized shade of gray without the subtitle to be the best and the white subtitle with the shadow to be middle best. While there was a distinctive ranking between the three images, subjective feedback later on led us to believe the gap between the DeltaE maximized shade of gray without the subtitle and that of the white subtitle with the shadow was not extreme. This yields us to believe that the effect of the shadow works best with white subtitles, and perhaps can compensate for lack of DeltaE differential. In addition, we asked participants to rate on a scale of 1-5 (5 as being the best) how visible the white subtitles with the shadow were. The average rating was 3.85, with a standard deviation of 0.75. There were no statistically significant difference between the five videos used in the polling, this inclues the black and white video.


	===More Images===		===More Images===